It took me a few years to work it all out. The trick is to NOT remove all pest affected plants, even in their off season. Pest numbers need to build up to attract predators and the predators lay eggs to overwinter on the same plants as the pests do.
It's so tempting to pull everything out at the end of season though. We all like a tidy garden.