Lost in the Middle: How Language Models Use Long Contexts

Catalog evidence and recorded chart appearances. Inclusion is not an endorsement.

Source snapshot imported 2026-10-20. This is not a live feed. Source and contributions.

Evidence and limits

Finding: Models often used relevant information less reliably when it appeared in the middle of long contexts, even when the context fit the advertised window.

Impact: Strengthen position-robust context tests and retrieval. Reject context-window size as effective-memory evidence.

Boundary: Tested models and context layouts will age. Next: which current models remain position-sensitive on repository-derived evidence?

Flags: model and layout sensitivity; synthetic key-value task

Record State: Catalog review recorded; not a performance endorsement

What was reviewed: Structure and relevance screened; not a full evaluation

Inspect original source

Recorded chart appearances

  • 2026-10-13: position 46. Relevant to the recorded review topic (see source); Structure and relevance screened; not a full evaluation evidence
  • 2026-10-12: position 45. Relevant to the recorded review topic (see source); Structure and relevance screened; not a full evaluation evidence