Skip to main content
PYRAMYD
Blog

Graph RAG · Research

Microsoft GraphRAG, Anthropic MCP, and the Convergence Pattern Nobody Is Talking About

Within 18 months, three independent research arcs — Microsoft GraphRAG, Anthropic MCP, and Neo4j's hybrid retrieval work — landed on the same substrate conclusion. The architectural primitives that show up in all of them tell you where the field is going.

Jonathan Krasnow · Founder & CEO, PYRAMYDFebruary 8, 202613 min read
Graph RAGMCPMicrosoft ResearchAnthropicSubstrate
Editor's noteThis post is part of our research-grounded series. Third-party statistics referenced here are being re-verified against primary sources as part of an ongoing content audit. Where the original source isn't machine-verifiable, we're reframing the claim qualitatively or citing the underlying primary paper directly. Reach out if you spot a citation that should be tightened.
ShareLinkedInXEmail

In April 2024, Microsoft Research published the GraphRAG paper.[1] In November 2024, Anthropic launched Model Context Protocol.[2] In March 2025, OpenAI added MCP support to its Agents SDK.[6] In April 2025, Google committed to MCP support for Gemini, and shipped it in the Gemini API in May.[7] In about thirteen months, labs that compete on almost everything else converged, between them, on two ideas: structured, graph-shaped retrieval for corpus-wide questions, and a standard protocol for reaching context.

Three competing labs · Microsoft, Anthropic, Google · between them converged on graph-shaped retrieval and a standard protocol in about thirteen months. That kind of convergence is rare. When it happens it's usually a signal that the architectural primitive is correct, not that the labs copied each other.

This post walks through the technical work that produced the convergence, the benchmark deltas that forced the field's hand, and the architectural primitives that show up in every serious implementation. The pattern is now stable enough to design around.

Section 1: The four shifts that defined the field

2020 · RAG (Lewis et al., Facebook AI Research)

The original RAG paper[4] established the pattern: retrieve the most relevant passages from a dense vector index at query time and condition the generator on them. Its common descendant · embed the corpus, fetch the top-k nearest chunks, paste them into the prompt · was the substrate for the 2022-2024 wave of "chat with your docs" products · Glean, Notion AI, ChatGPT Enterprise's first-generation document connectors, and countless startup pitch decks.

Vector RAG works well for what we now call "local" questions — queries whose answer is contained in a small number of contiguous document chunks. It fails predictably on global questions · queries that require synthesizing across an entire corpus, or traversing relationships between nodes.

2024 · GraphRAG (Edge et al., Microsoft Research)

Microsoft's GraphRAG paper[1] made the failure mode quantitative. On the Podcast and News benchmark sets they tested, GraphRAG's "global" query mode produced responses that were judged superior by an LLM evaluator at win rates of 72-83% on comprehensiveness (and 62-82% on diversity) against the baseline vector RAG approach. The trick: rather than retrieving raw text chunks, the indexer extracts a typed node-and-relationship graph, runs community detection on it, and generates per-community summaries that become the retrieval target.

Two architectural primitives from that paper became the field's defaults:

  • Indexer / Query split. The expensive node extraction + graph construction + community summarization happens offline during indexing. Online queries hit pre-computed structures.
  • Multi-level community summaries. Hierarchical Leiden clustering produces summaries at multiple granularities. Queries can be answered from coarser or finer community levels, trading cost against detail.

2024 · MCP (Anthropic)

The Model Context Protocol[2] solved a different problem: bespoke integrations. Before MCP, every LLM-to-data-source connection was a custom function-calling schema, custom auth, and custom error handling. After MCP, any context source — filesystem, Postgres, knowledge graph, SaaS API · exposes the same shape: tools[], resources[], prompts[]. The LLM client doesn't care which vendor is on the other end.

MCP is not technically novel. The novelty is the standard. Once Anthropic published the spec and shipped reference servers, the cost of building a graph-grounded agent dropped sharply. By mid-2025, OpenAI's Agents SDK and ChatGPT,[6] Google's Gemini API,[7] and the major IDE-integrated coding assistants had adopted it.

2024-2025 · Hybrid retrieval converges

Neo4j documented a widely used pattern for production graph RAG: vector search to find candidate seed nodes, graph traversal from those seeds to expand context, and cluster-level summaries for synthesis.[5] PYRAMYD uses a variant of this pattern.

Section 2: The convergence pattern

The four shifts above, taken together, define the production pattern that's now stable:

  • Typed node backbone. Every implementation worth deploying maintains a typed graph schema · nodes have types, edges have types, FKs are enforced. Microsoft's GraphRAG extracts the schema from text; Neo4j's reference assumes it; PYRAMYD's ships pre-built.
  • Community detection + hierarchical summaries. Leiden or Louvain clustering partitions the graph into communities of related nodes. Multi-level summaries make global queries tractable. Many implementations run some variant.
  • Hybrid retrieval. Vector search seeds the traversal; graph walks expand it. Cosine similarity finds the entry point; typed edges define the neighborhood.
  • MCP-shaped delivery. The retrieved subgraph is delivered to the LLM as a structured tool response, not raw text. The LLM can call back for more context as needed.
  • Citation traceability. Every retrieved fact carries a back-pointer to its source node or document. This is what makes the substrate auditable.

Section 3: What the original GraphRAG paper actually says

The Microsoft Research GraphRAG paper (Edge et al., arXiv:2404.16130, April 2024) makes a qualitative claim that is well-formed but narrowly scoped: GraphRAG “leads to substantial improvements over a conventional RAG baseline for both the comprehensiveness and diversity of generated answers” on global sensemaking questions evaluated against datasets in the 1-million-token range.[1] The authors don't publish a single headline percentage — they publish head-to-head win rates per evaluation dimension.

That nuance matters because the field has accumulated a lot of secondhand “3-4× lift” or “35-54% accuracy gain” numbers in derivative articles, none of which appear in the original paper's abstract or introduction. The honest summary is: graph traversal handles multi-hop reasoning that cosine-similarity chunk ranking can't, and Microsoft Research has the most-cited paper demonstrating that on a non-trivial benchmark.

Section 4: What this implies for the next 24 months

The convergence pattern means three things for any team building on top of LLMs:

  • Plain vector RAG is a dead end for global queries. If your product answers questions like "how is X changing across the market" or "which competitors ship features that overlap with our roadmap," you need graph traversal in the retrieval path. The benchmark gap is too large to ignore.
  • MCP is the protocol bet. Any retrieval layer you build today should expose its surface as MCP tools. The standard is settled enough that bespoke alternatives lose on ecosystem cost.
  • Typed node backbones beat extractor-only approaches. Microsoft's original GraphRAG extracts the schema from text — which works for unstructured corpora. For domain-specific substrates (the software market, financial markets, legal contracts) a pre-built typed backbone wins on accuracy because the extractor doesn't have to discover the schema each run.

Section 5: Where PYRAMYD lands in the pattern

PYRAMYD's Product Graph is the typed-backbone variant of the converged pattern. The 99 universal node types and more than 2,100 foreign-key constraints replace the extractor-derived schema. The community detection is replaced by the canonical taxonomy structure (category → industry → country, etc.). The retrieval pipeline uses pgvector embeddings to seed the traversal and graph walks to expand, following the pattern Neo4j documents.[5] Inside PYRAMYD, APEX is the delivery layer today. Over MCP, Claude Desktop, Cursor, Zed, ChatGPT, and Microsoft 365 Copilot can already reach competitors, signals, and battlecards with a personal access token; the rest of the graph is on the way, so the same graph can follow your team into those tools.

Where this lands for PYRAMYD customers

The substrate convergence is why PYRAMYD ships as an intelligence platform, not a chatbot: your product, its market, competitors, customers, and deals sit on one typed graph and retrieval layer, and APEX agents and the Studio tabs, from Dashboards and Sheets to Agents, work from it. The same primitives that Microsoft, Anthropic, Google, and Neo4j converged on, but pre-built for the specific shape of the software market.

The next 24 months will see a wave of products that look like GraphRAG variants on undifferentiated substrates · chat-with-your-Confluence, chat-with-your-Salesforce, chat-with-your-Notion. Those products will work, but they will be marginal because the substrate underneath them isn't typed enough to support the global queries the buyer actually has. The product graph for an entire vertical · the software market, in our case — is a different shape and produces different answers. The convergence pattern tells you why.

ShareLinkedInXEmail

References

  1. [1]Edge, D. et al., From Local to Global: A Graph RAG Approach to Query-Focused Summarization (Microsoft Research), arXiv:2404.16130 (v1 April 24, 2024; v2 February 19, 2025) (opens in a new tab) · The foundational GraphRAG paper · methodology and benchmarks. An LLM judge preferred GraphRAG's global answers over baseline vector RAG on comprehensiveness in 72-83% of head-to-head comparisons, across 1M-token sensemaking datasets.
  2. [2]Anthropic, Introducing the Model Context Protocol (November 25, 2024) (opens in a new tab) · MCP: open standard for connecting LLM clients to external context sources. OpenAI and Google announced support within about five months of launch.
  3. [3]Microsoft, GraphRAG (GitHub repository, released July 2024) (opens in a new tab) · Open-source reference implementation · indexer + query pipeline + community detection + node extraction.
  4. [4]Lewis, P. et al., Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks, NeurIPS 2020 (arXiv:2005.11401, May 22, 2020) (opens in a new tab) · Original RAG paper (Facebook AI Research, 2020) — the substrate the GraphRAG variants extend.
  5. [5]Neo4j Labs, GraphRAG (GenAI ecosystem overview page, 2024) (opens in a new tab) · Neo4j Labs' overview of the GraphRAG pattern: vector search combined with graph traversal, plus summaries of graph clusters.
  6. [6]OpenAI adds MCP support to the Agents SDK (announced by Sam Altman, March 26, 2025), reported by TechCrunch (opens in a new tab) · OpenAI adds MCP support to its Agents SDK, with ChatGPT support to follow; the move that made MCP a cross-vendor standard.
  7. [7]Google, Gemini 2.5: Our most intelligent models are getting even better (Google blog, May 20, 2025) (opens in a new tab) · Gemini API adds native SDK support for MCP, following Google DeepMind's April 2025 commitment.

See it with your own product.

Book a demo. We'll connect your product to its market, competitors, customers, and deals, and show APEX agents answering from that evidence with every source listed.