Tearing down arbitrarily is not the answer either. That's just post-modernism.
Tear down what is evil, I can get behind that. And I get what you're saying about not merely punishing the bad actors and moving on. That's not productive either, if we also keep what the bad actors built.