Think-on-Graph: Deep and Responsible Reasoning of LLMs on Knowledge Graphs

Think-on-Graph (ToG) introduces a paradigm where LLMs perform reasoning by actively traversing knowledge graph paths. The LLM iteratively explores the graph, deciding which edges to follow based on the reasoning task. Achieves state-of-the-art on multi-hop QA benchmarks with interpretable reasoning chains.