Part 6/14:
The progression from GPT-2 to GPT-3 exemplifies this: models have seen improvements of several orders of magnitude, transitioning from moderate to near-human capabilities in many domains. Today’s models are at an approximate intelligence IQ of 12 to 14, but projections indicate that within a year or two, models might reach IQ levels of 18, 19, or even 20—meaning they can handle virtually any cognitive task.
Beyond this point, additional improvements yield diminishing returns, and the primary focus shifts from raw intelligence to optimizing speed, efficiency, and reliability.