I've been avoiding use of flagging as well, though I hadn't articulated it this clearly. I don't agree with you on everything, and am happy that flagging exists, but I would rather tell someone to go piss up a stump, than to make an effort to reduce their success.
The case you make will have me looking more carefully to upvote those who take the time to comment, whether positive or otherwise.