The need to belong in some sort of group stems from our own insecurities. The less educated or informed an individual is, the more they need to feel 'accepted' by society.
That said, and since this sort of attitude seems to be the norm nowadays, I take it as a compliment when somebody tells me they think I'm crazy.
Have a good day!