So really I think the "not your keys" movement is more about keeping cryptocurrency as a decentralized system that no one can control or manipulate, rather than about security.
That's true... I just have zero confidence that using a hardware wallet counts as maintaining a decentralized system. For all we know backdoors already exist and government agencies/corporations already have full access to any one of these companies.