Quality, cost, latency trade-off

The quality, cost, latency trade-off means choosing the solution that meets the need at the best compromise, because improving one axis often degrades the others. You set an acceptable quality threshold, then pick the cheapest option that is fast enough and reaches it.

Example

A small model reaches the quality threshold at a third of the cost: it is chosen.

Related concepts

The whole glossary