Generation parameters

Generation parameters tune the model's behavior: temperature controls the amount of randomness, top_p restricts word choices, max_tokens limits the response length. A low temperature gives more stable outputs, suited to extraction and classification.

Example

{"temperature": 0.2, "top_p": 0.9, "max_tokens": 300}

Related concepts

The whole glossary