AI Glossary

Alignment

Also called AI alignment

What does “Alignment” mean?

Alignment: Making an AI system reliably pursue the goals and values its designers and users actually intend, rather than a distorted or literal-minded version of them. Researchers treat it as both a practical engineering problem today and a harder open question for more capable future systems.

Alignment visual guide: Making an AI system reliably pursue the goals and values its designers and users actually intend, rather than a distorted or literal-minded version of them. Researchers treat it as both a practical engineering problem today and a harder open question for more capable future systems.
Visual guide Open full size (new tab)

What is an example of “Alignment”?

A chatbot that refuses to help with harmful requests yet stays genuinely useful for legitimate ones reflects alignment work behind the scenes.

Keep learning

See also

AI safetyTermReward hackingTermSycophancyTermReinforcement learning from human feedbackTerm

Same topic

Mechanistic interpretabilityTermArena rankingsTermBenchmarkTermAI regulationTermBenchmark contaminationTerm