评分 6.0 · 来源：cs.CL updates on arXiv.org · 发布于 2026-04-08
评分依据：有一定参考价值的AI研究论文
arXiv:2512.20983v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly evaluated in clinical settings using multi-dimensional rubrics which quantify reasoning quality, safety, and patient-centeredness. Yet, replicating specific mistakes in other LLM models is not straightforward and often requires manual effort. We introduce MedMistake, an automatic pipeline that extracts mistakes LLMs make in patient-doctor conversations and converts them into a benchmark of single-shot QA pairs. Our pipeline (1) creates complex, conversational data between an LLM patient and LLM do