You are viewing a single comment's thread from:

RE: Adding external GPU to my AI box

in #ai2 days ago

Thank you very much for sharing KaraKeep and LM Studio. I will find time to learn them later.

I don't use local AI much, I mostly use providers, so it is mostly for fun as I need the speed more, but I am working on a project that I do not want my data in the cloud and once I can prove it is profitable, I will be getting some RTX 6000 Pros and Epyc CPUs to run Kimi K2 locally.

For a geek, having fun is the most important thing.
If you can have fun while making a lot of money, that’s even more perfect.
Sincerely wishing your project great success!