Part 3/10:
Prompt Windows: Utilizing fixed-size token windows ensures consistent input formatting.
Memory Techniques: To maintain context across exchanges, employing a sliding window approach or a "scratch pad" helps incorporate previous conversation turns. This allows the chatbot to access relevant past interactions dynamically.
The concept of a scratch pad is introduced as a form of long-term memory adjunct, stored externally (e.g., in a database or data store). It aids in providing contextually relevant responses by maintaining and retrieving pertinent information from prior interactions.
Architectural Components of the Chatbot
Delving into the architecture, David requests a breakdown of critical components and their interactions: