Part 3/10:
Similarly, with LLMs, as parameters increase into the trillions, the tangible benefits appear to plateau for many users. While new capabilities continue to emerge, the overall sense of exponential progress diminishes, prompting questions about whether we’re approaching an intelligence ceiling.
Drawing Parallels Between Graphics and AI
The analogy with graphics highlights an important point: beyond a certain number of triangles (say, 60,000 or even 6 million), the visual difference becomes negligible. The question is whether AI models will experience a similar diminishing perceptual returns once they saturate the space of useful representations and manipulations.