X-06Context Rot
Stale errors, dead ends and duplicates dilute attention long before the window is full.
Further reading
- Context rot: how increasing input tokens impacts LLM performance Chroma Research, 2025
- Lost in the Middle: How Language Models Use Long Contexts Liu et al., TACL 2024