---
title: "DistDebug-Bench: Can LLM Agents Diagnose Bugs in Distributed Systems?"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2611.03523v1"
permalink: "https://feed.astralor.com/items/itm_61f909c8d239c5ff9869d1c6"
published: "2026-11-02T17:56:28.000Z"
score: 56
channel: "tech"
tags: ["LLM","AI Agent","多模态","DistDebug-Bench","Can LLM Agents","Diagnose Bugs","Distributed Systems","Existing"]
---

# DistDebug-Bench: Can LLM Agents Diagnose Bugs in Distributed Systems?

## At a glance

LLM agents show strong potential in software engineering tasks such as competitive programming and code synthesis. Existing benchmarks, however, largely focus on small-scale settings such as self-contained Python module…

## Key points

- LLM agents show strong potential in software engineering tasks such as competitive programming and code synthesis.
- Existing benchmarks, however, largely focus on small-scale settings such as self-contained Python modules, leaving distributed systems, an essential class of production software, under-examined.
- We introduce DistDebug-Bench, a benchmark for evaluating agents' ability to diagnose complex-system failures at the code level.

## Full text

LLM agents show strong potential in software engineering tasks such as competitive programming and code synthesis. Existing benchmarks, however, largely focus on small-scale settings such as self-contained Python modules, leaving distributed systems, an essential class of production software, under-examined. We introduce DistDebug-Bench, a benchmark for evaluating agents' ability to diagnose complex-system failures at the code level. It curates 120 high-quality real-world bugs from 11 widely used distributed systems, spanning 5 programming languages and 10 failure patterns. Through an extensive evaluation of state-of-the-art LLMs and agents, we identify substantial gaps between current agents and real-world debugging tasks. A recurring gap is tunnel vision due to a lack of explicit reasoning structure and nondeterminism from inconsistent tool-use scope. The benchmark and evaluator are available at https://github.com/OrderLab/distdebug-bench, with agent traces and a leaderboard at https://distdebug.com.

---

Verify against the original before citing; curated by Astral Feed: https://feed.astralor.com/items/itm_61f909c8d239c5ff9869d1c6