[2404.16130] From Local to Global: A Graph RAG Approach to Query-Focused Summarization

-->

Computer Science > Computation and Language

arXiv:2404.16130 (cs)

[Submitted on 24 Apr 2024 (v1), last revised 19 Feb 2025 (this version, v2)]

Title:From Local to Global: A Graph RAG Approach to Query-Focused Summarization

Authors:Darren Edge, Ha Trinh, Newman Cheng, Joshua Bradley, Alex Chao, Apurva Mody, Steven Truitt, Dasha Metropolitansky, Robert Osazuwa Ness, Jonathan Larson<br>View a PDF of the paper titled From Local to Global: A Graph RAG Approach to Query-Focused Summarization, by Darren Edge and 9 other authors

View PDF<br>HTML (experimental)

Abstract:The use of retrieval-augmented generation (RAG) to retrieve relevant information from an external knowledge source enables large language models (LLMs) to answer questions over private and/or previously unseen document collections. However, RAG fails on global questions directed at an entire text corpus, such as "What are the main themes in the dataset?", since this is inherently a query-focused summarization (QFS) task, rather than an explicit retrieval task. Prior QFS methods, meanwhile, do not scale to the quantities of text indexed by typical RAG systems. To combine the strengths of these contrasting methods, we propose GraphRAG, a graph-based approach to question answering over private text corpora that scales with both the generality of user questions and the quantity of source text. Our approach uses an LLM to build a graph index in two stages: first, to derive an entity knowledge graph from the source documents, then to pregenerate community summaries for all groups of closely related entities. Given a question, each community summary is used to generate a partial response, before all partial responses are again summarized in a final response to the user. For a class of global sensemaking questions over datasets in the 1 million token range, we show that GraphRAG leads to substantial improvements over a conventional RAG baseline for both the comprehensiveness and diversity of generated answers.

Subjects:

Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

ACM classes:<br>H.3.3; I.2.7

Cite as:<br>arXiv:2404.16130 [cs.CL]

(or<br>arXiv:2404.16130v2 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2404.16130

Focus to learn more

arXiv-issued DOI via DataCite

Submission history<br>From: Darren Edge [view email]<br>[v1]<br>Wed, 24 Apr 2024 18:38:11 UTC (6,306 KB)

[v2]<br>Wed, 19 Feb 2025 10:49:41 UTC (6,322 KB)

Full-text links:<br>Access Paper:

View a PDF of the paper titled From Local to Global: A Graph RAG Approach to Query-Focused Summarization, by Darren Edge and 9 other authors<br>View PDF<br>HTML (experimental)<br>TeX Source

view license

Current browse context: cs.CL

next >

new<br>recent<br>| 2024-04

Change to browse by:

cs<br>cs.AI<br>cs.IR

References & Citations

NASA ADS<br>Google Scholar

Semantic Scholar

export BibTeX citation<br>Loading...

BibTeX formatted citation

&times;

loading...

Data provided by:

Bookmark

Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

Links to Code Toggle

Papers with Code (What is Papers with Code?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author

Venue

Institution

Topic

About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .

Which authors of this paper are endorsers? |<br>Disable MathJax (What is MathJax?)