AI Glossary

Test-time compute

Also called inference-time compute

What does “Test-time compute” mean?

Test-time compute: Computation spent after receiving a request to improve the answer, such as extra search or candidate evaluation.

Test-time compute visual guide: Computation spent after receiving a request to improve the answer, such as extra search or candidate evaluation.
Visual guide Open full size (new tab)

What is an example of “Test-time compute”?

A reasoning system checks several proposed solutions before responding.

Keep learning

See also

DecodingTermTemperatureTermTop-pTermBeam searchTermBest-of-N samplingTerm

Same topic

Self-consistency decodingTermVerifier modelTermToken probabilityTermState-space modelTermTop-k samplingTerm