AI Glossary

Catastrophic forgetting

What does “Catastrophic forgetting” mean?

Catastrophic forgetting: Losing previously learned abilities while training on new tasks or data.

Catastrophic forgetting visual guide: Losing previously learned abilities while training on new tasks or data.
Visual guide Open full size (new tab)

What is an example of “Catastrophic forgetting”?

A model fine-tuned on a new language becomes worse at languages it previously handled.

Keep learning

See also

Fine-tuningTermInstruction tuningTermKnowledge distillationTermContinual learningTermParameter-efficient fine-tuningTerm

Same topic

Adapter layerTermCheckpointTermBatch sizeTermClass imbalanceTermBatch normalizationTerm