Activities have hundreds of fields and many might still be active if you only change a few.
GAO Schedule Assessment Guide Best Practices for Project Schedules suggests keeping deleted activities and logic while setting duration to 0. See page 140 of 240.