What Is Chunking?

Chunking is splitting a long document into smaller pieces before handing it to an AI system, instead of feeding in the whole thing at once. Smaller pieces are easier to search and fit inside the limited amount of text a model can work with at one time.