Theory of Deep Learning

The course outline includes learning theory, SGD versus Bayesian approaches, generalization, neural architectures and large-width limits, and training dynamics such as grokking and in-context learning.

Recording

• Lecture 03 — How Neural Networks Learn

The English text is YouTube's auto-translation of auto-generated Arabic captions. Verify wording and technical terms against the recording.

Further reading

• Chapter 2.3: Deep Learning — introductory neural-network background.
• Mathematics for AI Safety — lecture notes and a mathematical perspective on AI safety.
• ILIAD Intensive Curriculum — background curriculum spanning machine learning and alignment.