Further Reading

- Vaswani et al., "Attention Is All You Need" (2017) — the original transformer paper, which sets up the attention mechanism that motivates the KV cache. - Ainslie et al., "GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints" (2023) — the paper that introduced and validated Grouped Query Attention as a practical KV cache reduction technique. - Dao et al., "FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness" (2022) — an honorable mention f