Fallback and spending cap

Fallback is the backup path when a model is unavailable or failing: another model, another provider, or a degraded response. The spending cap limits the cumulative cost of paid calls over a period, with blocking or degradation once it is reached.

Example

If the monthly cloud cap is reached, requests are served by the local model.

Related concepts

The whole glossary