Part 5/9:
This dynamic prompted the speaker to explore the concept of System One and System Two thinking, as described by Daniel Kahneman in his book, Thinking, Fast and Slow. System One signifies fast, intuitive responses, whereas System Two denotes a slower, more analytical approach. The speaker proposed that this absence of System Two thinking could be the missing link explaining the disparity in outcomes between the bot and human players.
After conducting experiments that revealed astonishing results, it became clear that giving the bot merely 20 seconds to deliberate on a poker hand would yield a performance boost equivalent to scaling the model size by 100,000 times. This significant discovery prompted the team to redesign the poker AI, focusing on enhancing System Two thinking.