Home / Figures / Chapter 2

Figure 2.4: The anatomy of a chat prompt

The anatomy of a chat prompt.
Figure 2.4 The anatomy of a chat prompt. Standing instructions go in the system message, the current request in the user message, and the model's own answers accumulate as assistant messages. Because the model retains nothing between calls, the surrounding software resends the entire stack on every turn (the accent loop)—what feels like memory is only the transcript being re-read.