I know what you're talking about. It started for me while meditating on mushrooms. Now happens most of the time when I meditate for a decent amount of time.
Freaks me out too. I think that's why monks are traditionally separated from society. Dealing with those experiences is a full time job.