When I saw 'all the people' I do not mean everyone.
Opinions on what is 'good' will vary. I just checked on the biggest accounts on https://hivebuzz.me/ranking (by effective HP). They are hardly downvoting, so that is a lot of potential power that is unused. The downvotes tend to be pretty focused and the reasons for that are varied. Sometimes people just fall out.
Someone should draw up some stats on where downvotes go. It could be interesting reading. I bet a lot is dealing with stuff like plagiarism. A faily limited amount is likely to be used for just adjusting rewards where Rancho has been. That's my guess anyway.
We each get to decide what we do with our vote. That's part of the freedom of Hive. Hive has its share of social misfits who may use it for 'evil'. We have no influence over them. We have to find ways to make it all work for the maximum benefit to the majority. I think in general it does work.