Context length

Topic

The context length, or context window, of a large language model is the maximum amount of text or other tokenized input that the model can process and consider at one time when generating output. Measured in tokens, it represents the span of information the model can directly "see" or remember during a single inference step. Anything outside of this limit is unavailable to the model unless retrieved or summarized.