It's up to the athletes themselves to realize that the opinions of these critics do not matter they should instead focus on their careers.
It is a hard job for normal people, and they are meant to be focusing on so many other things for their training. They are surrounded by pressure, which makes their outcomes even more incredible.