Evidence completeness and answer quality in graph-assisted retrieval-augmented generation

Abstract

For multi-hop questions it remains unclear whether retrieving more complete evidence actually improves the answers of retrieval-augmented generation. The study compares sparse, dense and entity-mention-graph retrieval with a shared reranker and a local quantized language model on reserved HotpotQA questions, and proposes an evidence-to-answer decomposition that separates the effect of evidence coverage from the effect of evidence utilization. Graph-assisted retrieval kept complete evidence more often than dense retrieval, but its answer gain was not statistically resolved and was explained mainly by how the generator used the evidence rather than by retrieval coverage.

Keywords: retrieval-augmented generation, multi-hop question answering, entity mention graph, evidence coverage, answer quality

Дәйексөз келтіру үлгісі

Mukhambetov Bektas, Noken Rakhima, Tarlan Baimyrza, Yskak Zhanibek Evidence completeness and answer quality in graph-assisted retrieval-augmented generation // «Орталық Азия ғылымы мен білімі: цифрлық трансформация және тұрақты даму» халықаралық ғылыми-тәжірибелік конференциясының материалдары (CASJ-2026). — 2026. — С. 21–29. — URL: https://cajournal.kz/conf-paper.php?id=5

Конференцияның барлық баяндамалары