Scalable Oversight

Planned topics include supervising stronger systems with weaker evaluators, safety via debate, weak-to-strong generalization, decomposition, and AI-assisted evaluation.

Add lecture notes, readings, and transcripts here as the course progresses.

Further reading

• Measuring Progress on Scalable Oversight for Large Language Models — proposes empirical ways to study human supervision with model assistance.
• AI Safety via Debate — introduces debate as a method for eliciting supervision signals.
• Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision — studies supervision of stronger models using weaker supervisors.