What you'll unlock:

• 1. The Alignment Problem
• 2. Supervised Fine-Tuning Baseline
• 3. Reward Modeling from Pairwise Preferences
• 4. PPO for RLHF: The InstructGPT Recipe
• 5. The KL Constraint and the Reference Model
• 6. Implementing RLHF on a 125M Model