If you explain why, in some cases you can achieve a change in behavior.
Let me give you a real example: Hurtlocker gave some negative votes in the Rising Star community a while ago.
The Rising Star Discord chat discussed it.
What I mean is that if downvotes are going to be discussed, the reasons can also be addressed, especially if an explanation is provided.
It's simple: "This in particular bothered me." And you usually have a valid reason for giving the downvote.
I can affirm that even when I did give him reason to DV me, he refrained and simply pointed out the injury I had done him. He hasn't ever DV'd me despite my rather strident discussion that strayed into insuperable comment at least once.