Evaluation Metrics for GraphRAG Systems

GraphRAG evaluation requires metrics across three dimensions: Retrieval Quality (Precision@k, Recall@k, NDCG, MRR), Generation Quality (Faithfulness, Answer Relevance, Context Relevance, Coherence), and Graph Quality (Entity Extraction Accuracy, Relationship Accuracy, Community Coherence, Graph Completeness). Tools include RAGAS framework, DeepEval, and custom LLM-as-judge pipelines.