Definitely I really get your point of view very clearly now as some users in future might later turn it or start using it as a means of intimidating other user's or some might see it as a way of scrapping off rewards from a content or comment just because they are not of the opinion of what the author is saying or what the content Carries.
To actually avoid all this scenario from occuring in future,so that we won't have to see different scene of users downvoting each other for enemity sake, something should be done about it.