I have been to all continents besides Australia and Antartica, but most of my trips have been work related. I enjoyed them, but they also made me tired. Also, doesn't help that unlike you I'm an introvert. I'm fine with leaving home for 3 or 4 times a year, but more than that is too tiresome for me.
I actually am an introvert too. Traveling can be exhausting, especially when I'm doing it with other people.