Reading Guide

Follow the concepts and prerequisites that connect the material. Each topic develops an explanation, identifies its assumptions, and points to the questions that follow.

Build the mathematical foundations

Start here if you want to understand how models learn and what their measured performance means. Basic probability, linear algebra, and differentiation are useful throughout.

  1. Language models and loss: conditional distributions, training targets, negative log-likelihood, and cross-entropy.
  2. Scaling and compute: how data, parameters, and compute relate to prediction loss.
  3. Generalization and learning dynamics: why fitting training data leaves questions about unseen data, inductive bias, and learned features.

The topic pages contain the definitions, examples, and calculations directly, so you can follow this sequence without moving between source documents.

Understand safety risks

Begin with capabilities and AI research feedback for the motivating questions about automation, incentives, and bottlenecks. Return to scaling when you need the technical background for claims about compute.

Then choose a question:

Find a research question

Use research directions to connect open questions to their conceptual prerequisites. The nine questions are grouped by subject and include their references.

The research practice examples and project proposals provide additional starting points. Check related work before treating a question as a novel contribution.

Read the papers and join the discussion

Use related papers for an annotated bibliography and discussion notes for questions across topics. The homepage links to the source archive for checking original wording and provenance.