The drama between downvotes has always been crazy and it's something you just have to get used to. At least, it's better than the current system as you are still rewarded for your efforts. Overtime, the dilution of their staked HP will go down unless they are active on the chain so I don't think it has too big of an effect.
Posted Using LeoFinance Beta
That dilution of stake is important, with quite a few getting out over time, never to return with much force.