All terms
Reliability and knowledge
Attention degradation
Attention degradation describes the observed tendency for a model to use some relevant context less reliably as prompts become long, noisy, or contradictory. The severity varies by model and task.
Example
A key acceptance criterion buried among stale notes may be missed when the agent writes a patch.