Premium Content

Inverse-Gradient Balancing: The Idea

Equalize each task's contribution to the shared backbone by giving lower weight to whichever task has bigger gradients.

This chapter requires a subscription to access.

What you'll unlock:

  • 1. Equalizing Task Contributions
  • 2. Why Inverse-Proportional Weights Work
  • 3. The Two-Task Closed Form
  • 4. How GABA Differs from GradNorm
Subscribe to Unlock

Already have an account? Sign in