FREE PRACTICAL AI LEARNING · LEARN BY DOINGNO SIGNUP NEEDED · YOUR WORK STAYS YOURS
Open PracticePRACTICAL AI ENGINEERING
AI GLOSSARY · PROMPTING

Max tokens

A limit on how long the model’s reply can be, which also caps cost.

Example

Setting max tokens to 300 keeps answers short.

Learn it by doing

Reading a definition is a start; using the idea makes it stick.

Try it in practice →

Related terms

← All AI terms