I test a lot of models, I thought about starting inference service myself and looking at whole setup number, I felt myself like pizza delivery guy it was that expensive lol.
You are viewing a single comment's thread from:
I test a lot of models, I thought about starting inference service myself and looking at whole setup number, I felt myself like pizza delivery guy it was that expensive lol.
Yeah, you can never compete with datacenters for the inference price... Not because they run it cheaper, but because they can afford to operate on a loss for years in advance.