AI GLOSSARY · HOW IT WORKS
Streaming
Sending a model’s reply piece by piece as it is generated, so users see text appear immediately.
Example
Chat apps that type out answers word by word use streaming.
Learn it by doing
Reading a definition is a start; using the idea makes it stick.
Related terms
HOW IT WORKSTokenA chunk of text (often part of a word) that models read and write. Pricing and limits are counted in tokens.HOW IT WORKSContext windowThe maximum amount of text (in tokens) a model can consider at once, including your prompt and its reply.HOW IT WORKSInferenceRunning a trained model to get an output. Every chat reply is an inference call.HOW IT WORKSTrainingThe process of adjusting a model’s weights using data so it learns patterns.HOW IT WORKSTraining dataThe examples a model learns from. Its quality, coverage and bias shape what the model can do.HOW IT WORKSFine-tuningFurther training an existing model on a smaller, specific dataset to specialise it.