I wouldn't say you travel inside your mind. Well, not in way mainstream 'science' say that mind is located only in your brain. If your awareness is located only in your brain, this phenomena wouldn't be possible. RV and many other phenomena like OBE's and NDE's show that consciousness exist beyond material world.
In my opinion thru remote viewing you are just accessing that level of reality.