You are very correct on this. Some people in the quest to become a minimalist, they limit themselves to certain enjoyment while suffering themselves. All it takes is being able to balance life in such a way that even when you are practicing minimalism, it shouldn't stop one from enjoying life because as my sister would say, life doesn't have a duplicate, if you don't enjoy it now, someone else will enjoy all you have ever worked for.