Skip to content
ML Academy

Introduced on day 42

Context window

The maximum number of tokens, prompt and generated output together, that a model can attend to in one request.

In detail

Anything outside the window is invisible to the model. Prompt, retrieved passages, tool results and the answer share the budget. A larger advertised window does not guarantee that the model uses all of it well, so effective context should be tested at your own input lengths.