Part 4/10:
A striking feature of the report is the astonishing reduction in energy required to generate tokens for language models. An extraordinary 105,000-times decrease over the past decade illustrates why current developments in AI are achievable at unprecedented efficiency levels.
Alongside this, Maker notes a staggering 99.7% cost reduction in the operational expenses associated with AI over the past two years. To highlight just how radical these changes are, she contrasts the trajectory of AI cost reductions to that of historical innovations, such as the light bulb, demonstrating the rapid evolution of AI technologies.