Context window

The context window is the maximum amount of text (measured in tokens) that a model can take into account at once, input and output combined. Beyond that, the oldest information is lost or truncated. It limits the size of the documents and conversations that can be processed.

Example

A long conversation exceeds the window: the model no longer has access to the first instructions.

Related concepts

The whole glossary