Automatic metrics

Automatic metrics are measurements computed by code to evaluate outputs: accuracy, exact match, format validity, recall, precision. Fast and reproducible, they suit verifiable outputs, but measure the quality of free text poorly.

Example

accuracy = correct answers / total answers

Related concepts

The whole glossary