Entirely agree with you. Ending up in a ballot box is a proof of obedience. Some states even have compulsory voting, like Belgium. People not attending the ballot receive a fee.
All the power our rulers have is given by the people, and can easily be taken back.