"This distillation technique is just so extremely powerful and so extremely cheap, and it's just available to anyone," said Databricks CEO Ali Ghodsi, adding that he expects to see innovation when it comes to how large language models, or LLMs, are built. "We're going to see so much competition for LLMs. That's what's going to happen in this new era we're entering."
Distillation is now enabling less-capitalized startups and research labs to compete at the cutting edge faster than ever before.