AI GLOSSARY · HOW IT WORKS
Context window
The maximum amount of text (in tokens) a model can consider at once, including your prompt and its reply.
Example
A 128K context window fits a long report; an 8K window does not.
Learn it by doing
Reading a definition is a start; using the idea makes it stick.
Related terms
HOW IT WORKSTokenA chunk of text (often part of a word) that models read and write. Pricing and limits are counted in tokens.HOW IT WORKSInferenceRunning a trained model to get an output. Every chat reply is an inference call.HOW IT WORKSTrainingThe process of adjusting a model’s weights using data so it learns patterns.HOW IT WORKSTraining dataThe examples a model learns from. Its quality, coverage and bias shape what the model can do.HOW IT WORKSFine-tuningFurther training an existing model on a smaller, specific dataset to specialise it.HOW IT WORKSEmbeddingA list of numbers that represents the meaning of text, so similar meanings are close together.