STAIR (STructure Aware Information Retriever): A novel dataset and LLM based retriever for document structure augmentation
Retrieval Augmented Generation (RAG) is a key component for generating accurate and hallucination free answers using Large Language Models (LLMs). LLMs are improving at handling long context, but still suffer from "lost in the middle" problem. Thus, precise and accurate retrieval is important. Current retrievers chunk long context into length-based manageable chunks - in the process throwing away…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
