The best a government can do is prevent A from violating the rights of B, and vice versa. This is better than existing to "protect the people".
We will always need a way to govern ourselves. This is part of being social beings. However, that does not mean we need a political form of government to allow us to govern ourselves. For an example, look no further than the family unit.