Hive shares reward pool.
A quick solution is using tribal frontends and focus on improving your stake in those sites like pob etc
Or if u want full control, create your own tribe token where u can't be downvoted. Or just use vyb tribe with no downvotes.
As long as u share same reward pool of $HIVE with others, u are exposed to receive downvotes.
The way $HIVE works is, it's not your money before 7 days and whatever u get is based on upvotes and downvotes combined.
If u disagree with the way it works, there r many more options but it might be attractive for you because no one or not many would be controlling abuse there.