Context Window

Span of text LLM can remember

ModelsTechnical
Back to Glossary
Updated 2 May 2025

Definition

The span of text an LLM can "remember" or consider in a single interaction or prompt. A context window of 8K tokens might allow reviewing a full contract in one go.