When someone says they "don't judge" - that is a judgement too.
It is also survival mechanism too. For example, parents telling not to be friends with kids of mafia, was not just a warning, but a future survival tactic. Because with every such connection there comes a catch. And nothing comes easy in survival when you associate with potential awkward networking choices. Judgement sometimes saves you from variety of issues in life.
It is what sets us apart from the animals, because it means that we don't just act on instinct alone. We have evolved to be judgmental - pretending that we haven't is to remain ignorant to who we are.