RoPE — Rotary Position Embedding

Su et al. 2021 — position via rotation of Q and K vectors

This chapter requires a subscription to access.

Already have an account? Sign in