Chunk Overlap

Chunk overlap is the number of tokens shared between consecutive chunks when splitting a document. Overlapping chunks ensure that sentences or ideas spanning a chunk boundary are represented in at least one complete chunk, reducing the risk of retrieving a passage that cuts off mid-thought. Too little overlap risks losing cross-boundary context; too much overlap inflates the index size and increases redundant retrievals without proportional quality gains.