I wouldn't say it's getting harder to remain anonymous. The real problem is that it's becoming very expensive. Who has the money for four DGX Sparks to run GLM 5.2 locally? Big tech is also buying so many servers and GPUs that we, as consumers, can't afford them anymore. That's why the cloud is gaining more and more ground. I'd love to run my AI locally, but I can't afford to right now. If the AI bubble bursts, I can see a future where local AI will really shine!
You are viewing a single comment's thread from:
I mean, yes and no. You can buy small servers, raspberry pi ones, also more powered machines on the 400-700 price range. At least I saw this one:
However the point is more about the merge with your person. This is the start of cybernetics. We still not replacing human parts but we are already wearing them and they are aware of us.
16GB of VRAM isn't really enough for coding or research. Take a look at GLM5.2, you would need at least 512GB of VRAM. You can run 20B models or Gemma4 for everyday questions, but these tasks don't really benefit from AI IMO.
Gemma4 could also run on a phone, which consumes much less power than an AMD BC-250, which uses about 120 to 350 W.