Unfortunately and fortunate for people like us, waking up is a lonely process, and yes those that are not 'awoke' have no choice but to leave our paths. The good news is you've been woken for a reason, either teach and share a message, or do do great things you've never imagined you would or could do!
Take this from me - don't try to hold on to the people that are letting go, including family. If they were meant to be on your path, they'll be back on their own accord. I agree, it can be a lonely and painful experience, but don't despair because sooner or later you'll know why you had to walk this path alone. Peace.
Thank you brother! Letting go is really hard, but like you said, if people are not ready tan they are not ready.