Premium Content

FP8 Mixed-Precision Training

Why FP8 training is hard, DeepSeek's fine-grained quantisation and high-precision accumulation solutions.

This chapter requires a subscription to access.

What you'll unlock:

  • 1. The Case for FP8
  • 2. Why Naive FP8 Training Fails
  • 3. Fine-Grained Quantisation
  • 4. High-Precision Accumulation
  • 5. What Stays in BF16 and FP32
  • 6. Implementing FP8 Training
Subscribe to Unlock

Already have an account? Sign in