Premium Content

RoPE — Rotary Position Embedding

Su et al. 2021 — position via rotation of Q and K vectors

This chapter requires a subscription to access.

What you'll unlock:

  • 1. RoPE — Rotary Position Embedding
Subscribe to Unlock

Already have an account? Sign in