Rather than run its own data centers, Baseten runs its software on data center equipment from cloud providers, including Amazon and Google. Customers can supply their own infrastructure with an enterprise tier. By drawing from multiple providers, Baseten offers access to more GPUs than a single cloud's current supply.
"In this market, your No. 1 differentiation is how fast you can move. That is the core benefit for our customers," co-founder and CEO Tuhin Srivastava said. "You can go to production without worrying about reliability, security and performance."
Companies can manage the deployment of their models without Baseten, but securing enough Nvidia chips in the right geographical areas can prove difficult, co-founder Amir Haghighat told CNBC.