AI Glossary
Temporal difference learning
Also called TD learning
What does “Temporal difference learning” mean?
Temporal difference learning: Learning predictions using the difference between a current estimate and a later observation plus a new estimate.

What is an example of “Temporal difference learning”?
An agent updates a state's value after taking a step and seeing the next state.