Our ideas about what others might think seem to often hurt more than the reality of things!
That's exactly the point.
So it's better to work on ourselves, have virtues that we live by, and then understand more about ourselves to know what we're about. That way, it doesn't matter what others think... and living by your virtues you can only trust that others will see you the way you are, and not by how they see themselves.
Always remember, we think what we are... or we see the world how we see ourselves.