That's interesting. I guess it's not something we'd remember. I had family members with different accents and these days bilingual families are probably more common than they would have been many moons ago. I'd also say that we may find strong accents uncomfortable as we can struggle to understand them.
I believe there is also evidence that we tend to gravitate towards people more like ourselves when among strangers, but like you say, this doesn't mean we hate those not like us.
I probably appreciate the school I went to more since having my own children and experiencing the public school system.