You pointed out a flaw. If people flag it then it is going to reach out to however many Jurors the system is set up to reach out to. Depending upon how that notification is received that can be a nuisance. IF they do not respond within a certain time the flag passes.
However, if bots or something are designed to down vote a lot (such as hivewatcher, steemcleaner type stuff) then that could trigger a lot of these things in mass which would suck and could cause problems.
As to solutions to that. Certain accounts could be flagged to be excluded from the process by something similar to how witnesses are elected. You'd want it to be an election process so that it remained something that is decentralized and such accounts could be removed from exclusion if they lose the support of the hive community.
Such accounts could be used without triggering the process.
Yet that wouldn't stop people from writing other bots to do this. You could monitor how long it has been since an account submitted a flag/down vote and have a cool down period.
There are numerous ways things can be approached.