That's the counter argument - humanity is still here. Calculators didn't destroy it, and the economy is still prospering despite them!
But society isn't. And no, that's not the calculators fault. It's one little thing among the many that make us too comfortable and restrict us from thinking things through. From having that experience, that challenge, that blockade we need to get through. Life as surviving is getting easier and easier, thanks to technology. For some, that is necessary still. But for others, who live in over-developed countries, it's slowly destroying life.
Of course I am big fan of technology in general. There are still lots of people doing great things. But as you suggest there can be downsides...and I will recommend this book if you really want to see some ugly sides of science. "Pandora's Lab: Seven Stories of Science Gone Wrong", by Paul Offit MD. A great book, and of course many other books have been written on the many dangers of AI.
All for now - off to play pickleball!