ALiBi — Attention with Linear Biases

Press et al. 2022 — linear distance penalty, no positional embeddings

This chapter requires a subscription to access.

Already have an account? Sign in