Simply adding the reason why you don't want to upvote it might be enough. I've just done that on some of the ones you have downvoted.
I'm not a patient person either, but life has taught me to have more - especially with other people who do not have the experience I have.
Anyway, I hope you have a great day.