shaharl6000.bsky.social
@shaharl6000.bsky.social
Previous work shows that adding more documents can hurt LLM performance, but didn’t isolate the impact of document quantity under a fixed context length.
Our findings reveal that increasing the number of retrieved documents in RAG settings significantly challenges LLMs.🤯
2/3
March 11, 2025 at 2:33 PM
Can RAG performance get * worse * with more relevant documents?📄
We put the number of retrieved documents in RAG to the test!
💥Preprint💥: arxiv.org/abs/2503.04388
1/3
March 11, 2025 at 2:32 PM