RAGU: A Multi-Step GraphRAG Engine with a Compact Domain-Adapted LLM
AuthorsMikhail Komarov, Ivan Bondarenko, Stanislav Shtuka, Oleg Sedukhin, Roman Shuvalov, Yana Dementyeva, Matvey Solovyov, Nikolay O. Nikitin
RAGU builds cleaner knowledge graphs with a compact language model, making GraphRAG more accurate, efficient, and practical.
Key results
Compact extraction model used by RAGU and deployable on a single consumer GPU.
Relative harmonic-mean improvement of Meno-Lite-0.1 over Qwen2.5-32B.
RAGU’s highest Evidence Recall on GraphRAG-Bench Medical.
RAGU score on GraphRAG-Bench Medical Creative Generation.
Approximate RAGU graph-construction cost in dollars per document on rented GPUs.
What the paper found
RAGU, developed by researchers at ITMO University and partner institutions, is an open-source GraphRAG engine designed to reduce the noise and brittleness of single-pass knowledge-graph construction used in systems such as Microsoft GraphRAG and LightRAG. Its six-stage pipeline separates typed entity extraction from relation extraction under the NEREL schema, then applies DBSCAN-based deduplication, LLM summarization, Leiden community detection, and configurable local, global, hybrid, or query-plan search. The companion Meno-Lite-0.1 is a compact 7B model fine-tuned for contextual comprehension and extraction rather than broad factual recall; it surpasses Qwen2.5-32B by 12.5% relative harmonic mean on knowledge-graph construction while matching larger models on GraphRAG tasks. On GraphRAG-Bench Medical, RAGU achieved evidence recall up to 0.84 versus ≤0.76 for competitors, and on Creative Generation it reached 59.0 answer correctness and 57.4 coverage, compared with HippoRAG 2’s 56.9 and 34.7. HippoRAG 2 remained stronger for precise single-fact retrieval and the hardest MuSiQue multi-hop benchmark, while RAGU’s apparent deficits on other factoid tests narrowed substantially under terse answer formatting. Unlike pipelines requiring large hosted models such as OpenAI’s GPT-4-class APIs, RAGU runs on a single consumer GPU, processes roughly 8K tokens per document at about 2K tokens per second, and costs approximately $0.001 per document versus $0.10 for commercial indexing. The implementation emphasizes production reliability through swappable graph, key-value, and vector stores, Pydantic-validated outputs, asynchronous execution, incremental updates, deterministic identifiers, and approximately 374 automated tests.
Original abstract
Graph retrieval-augmented generation (GraphRAG) enhances large language models with structured knowledge, yet existing systems construct knowledge graphs in a single extraction pass, producing noisy entities and brittle retrieval. RAGU, an open-source modular GraphRAG engine, addresses this by separating extraction from consolidation: entities and relations pass through two-stage typed extraction, DBSCAN-backed deduplication, LLM summarization, and Leiden community detection. A key insight motivates a compact extractor: the skills an in-pipeline LLM needs - comprehension, extraction, reasoning over context - are language skills that grow only weakly with model size, unlike factual world knowledge. Accordingly, we train Meno-Lite-0.1, a 7B model optimized for language skills, which outperforms Qwen2.5-32B on knowledge-graph construction (+12.5% relative harmonic mean) and matches it on English GraphRAG tasks. On GraphRAG-Bench (Medical), RAGU retrieves the most complete context at every factoid level (evidence recall up to 0.84 vs. $\leq$0.76) and overtakes HippoRAG2 on synthesis tasks; on multi-hop factoid QA, the apparent HippoRAG2 advantage is shown to be largely an answer-format artifact. RAGU is installable via $\texttt{pip install graph_ragu}$, runs on a single GPU, and is released under MIT. The source code is publicly available at https://github.com/RaguTeam/RAGU, and the Meno-Lite-0.1 model can be obtained from https://huggingface.co/bond005/meno-lite-0.1.
Read the original paperMore in Graph Learning
Browse all 32 papers →CodeGraph: Open-Taxonomy Knowledge Graph for Source Code with Wikidata Grounding
Federico Pennino, Andrea Gurioli, Stefano Zacchiroli, Maurizio Gabbrielli, Paolo Ferragina
CodeGraph turns 167 million source files into a Wikidata-grounded knowledge graph of algorithms, paradigms, patterns, and software domains.
GraphWrit3R: End-to-End 3D Scene Graph Writing
Luka Milivojevic, Nikola Popovic, Sayan Deb Sarkar, Sebastian Koch, Iro Armeni, Luc Van Gool, Danda Pani Paudel
GraphWrit3R turns 3D spatial data into open-vocabulary scene graphs using multimodal encoders and an LLM, without requiring ground-truth object annotations at inference.
Statistical Inference for Causal Discovery under Selection and Latent Variables via Single-Target Interventions
Xiaotian Hou, Kwangmoon Park, Hongzhe Li
This work shows how a small, carefully designed set of single-variable interventions can recover causal structure even when hidden confounders and selection bias complicate the data.