Chunking

Chunking splits source documents into smaller passages before embedding them for retrieval. Chunk size and overlap trade off between precision and context: small chunks retrieve tightly but may lose surrounding meaning, while large chunks preserve context but dilute relevance. Good chunking respects natural boundaries like sentences, headings, or code blocks.