See, this is exactly what both concerns and interests me about the idea of home schooling - the idea of kids being fully removed from the social aspect of public education, and both its positive and negative impacts.
If kids that are home schooled miss out on all of that socializing and "street-talk" that takes place both in and out of the classroom, from the benign stuff like what's hot in music at the moment, to more serious fare like local sites of interest from field trips and such, I could see them viewing it as somewhat of a disadvantage growing up. But then again, being shielded from all that seems to have allowed you to focus on what was really important information at the time, and then you were better prepared earlier in life for further education, where most others would have been struggling with the adjustment.
It may have shifted your socialization process inversely, somewhat, but you seem to have taken in everything regarding both education and socialization sooner overall, because of it.