Lost in the Middle

Lost in the middle is a documented failure mode where language models recall information placed at the beginning or end of a long context more reliably than information placed in the middle. When many documents are inserted into a prompt, facts buried in the center are disproportionately ignored. Mitigation strategies include reranking retrieved passages to place the most critical content near the start or end of the context.