Anarchism does carry with it very negative connotations. It's actually considered fringe to self identify as an anarchist.
The other thing is at what point does a person discover they are an anarchist? It probably is rude to label someone an anarchist prior to them discovering they are.