You can have Reward Distribution vetoed for the author part that is just fine, but including the curation rewards and the 'Reputation' score is creating a social outlaw situation. Everyone engaging with a creator that gets even some small degree of downvotes is getting damaged as well. The moral choice is to leave as soon as you attracted a downvote trail, and that is what people do unless they are actually scamers.
Indeed this is very unfortunate.