It's funny you should say that, I have literally just come off the back of an argument on Facebook with one of my friends, and they displayed the exact thinking you mention above. They called me racist for teaching my daughter the cultural reasons for wearing a niqab and/or hijab.
Cg