Probably. Could one solution be that you can choose then if you wanna vote on posts, but dont have auto voting, or have a other type of vote where you say I wany user x to have my vote. Not sure how that vote value would be calculated or so. But maybe you choose that like once a week or something instead and if you dont check in these votes decay?
Not sure if I make myself clear or not 🧐