Context window
What is context window?
The context window is the maximum amount of text — measured in tokens — a model can consider in a single request, covering the instructions, supplied documents, conversation history and the response.
Larger windows reduce the need for aggressive retrieval but increase cost and latency, and accuracy still degrades on information buried in the middle of very long inputs.
Last reviewed by the gAIcko editorial team.