Grouped-Query Attention (GQA)

Ainslie et al. 2023 — the sweet spot between MHA and MQA

This chapter requires a subscription to access.

Already have an account? Sign in