Context Window

A context window is the maximum amount of text, measured in tokens, that a language model can consider at once when generating a response.

Everything the model reasons over in a single call — instructions, retrieved documents, conversation history, and the current input — must fit within the context window.

Larger windows let an agent hold more context, but tokens are an input cost, so retrieval is often used to supply only the most relevant material rather than everything.