That's correct. The government and military is made up of "average people". Let's put away our perceptions of false authority figures and remove them from their pedestals. They are no more powerful and have no more natural rights than you or I.
As @maxigan said in closing: "if a Government, any Government, as corrupt as the ones that hold power in the world today, with police as heavily armed and as brutal as those we see today - most especially in the United States, seeks to ban firearms, say: No problem - You first."