---
title: "结构化音频描述评估框架：通过受控扰动验证的多轴评价方法"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2607.21424v1"
permalink: "https://feed.astralor.com/items/itm_2034282dd869a4e38f03d468"
published: "2026-07-23T15:26:52.000Z"
score: 75
channel: "tech"
tags: ["AudioCards","LLM法官","音频描述评估"]
---

# 结构化音频描述评估框架：通过受控扰动验证的多轴评价方法

## AI 点评

> 这篇论文对多模态评估领域有重要参考价值，特别是结构化音频描述的输出格式正成为趋势。如果你在做AAC或相关生成模型的评测，这篇框架值得深入阅读，它能帮你区分模型是否真正理解了音频内容。

## 速览

针对自动音频描述（AAC）从单一句子生成转向结构化格式的趋势，现有评估指标无法有效衡量多模态属性。本文提出一种多轴评估框架，基于AudioCards数据集，沿标签集、描述、逻辑推理、数值测量和频谱轮廓五个正交轴进行评估，结合LLM法官与确定性计算指标，并引入受控扰动测试协议验证可靠性。实验表明，该框架可有效区分意义保留的释义与真正的语义/声学破坏。

## 关键点

- 提出基于五个正交轴的结构化音频描述评估框架，覆盖标签、描述、逻辑、数值与频谱。
- 融合LLM法官的语义判断与确定性声学计算指标，提升评估全面性。
- 设计受控扰动测试协议，注入分级错误以验证框架可靠性。

## 全文

Recent advancements in automated audio captioning (AAC) have shifted from monolithic sentence generation toward structured formats that explicitly disentangle distinct acoustic and semantic properties. However, evaluating this heterogeneous data remains a significant challenge. Existing caption metrics focus on flat textual outputs and fail to reliably assess multimodal attributes. To bridge this gap, we propose a multi-axis evaluation framework tailored for structured audio descriptions. Building on the AudioCards dataset, we evaluate outputs across five orthogonal axes: tag-sets, descriptions, logical reasoning, numeric measurements, and spectral profiles. Our approach combines Large Language Model (LLM) judges to capture semantic nuance with deterministic computational metrics to precisely measure acoustic deviations. To rigorously validate the reliability of this framework, we introduce a controlled perturbation testing protocol that injects typed, graded errors into groundtruth annotations. Our results demonstrate that this framework successfully distinguishes meaning-preserving paraphrases from genuine semantic and acoustic corruptions.

---

引用前请核对原文;本文由星际流动整理:https://feed.astralor.com/items/itm_2034282dd869a4e38f03d468