Routing

Routing chooses, depending on the request, the handling to apply: which model, which prompt, or which tool. A lightweight classifier or rules direct each request to the appropriate path, which saves cost and improves quality.

Example

Simple question -> small model; complex analysis -> more powerful model.

Related concepts

The whole glossary