解开伊比利亚语言跨语言说话人验证中的说话人与语言效应
评分
54精选理由
方法创新性高,实验结果清晰,但仅限于五种伊比利亚语言,泛化性待验证。
AI 点评
「该研究为跨语言说话人验证中的语言依赖性提供了更精确的归因,有助于设计更鲁棒的跨语言说话人识别系统。」
速览
跨语言说话人验证系统在 Enrollment 和测试语音语言不同时性能下降。但标准评估协议混淆了语言不匹配与说话人间变异性,因为不同语言的说话人往往不同。本研究引入了一个双语同说话人评估集(涵盖五种伊比利亚语言),在恒定说话人身份下分析跨语言 SV。基于 HuBERT 系统,利用跨语言迁移矩阵(CLTM)分析配对迁移。结果表明,说话人相关变异性部分解释了性能下降,但语言不匹配仍是主要原因。这为跨语言 SV 的语言依赖性提供了更精确的表征。
- 提出双语同说话人评估集,覆盖五种伊比利亚语言,分离说话人与语言因素。
- 使用 HuBERT 模型和 CLTM 矩阵定量分析配对跨语言转移。
- 发现语言不匹配是跨语言性能损失的主要因素,说话人变异性仅解释部分下降。
正文
Electrical Engineering and Systems Science > Audio and Speech Processing
arXiv:2607.01161v1 (eess) [Submitted on 1 Jul 2026]Title:Disentangling Speaker and Language Effects in Cross-Lingual Speaker Verification for Iberian Languages
Authors:Pol Buitrago, Javier Hernando View a PDF of the paper titled Disentangling Speaker and Language Effects in Cross-Lingual Speaker Verification for Iberian Languages, by Pol Buitrago and Javier Hernando View PDF HTML (experimental)Abstract:Cross-lingual speaker verification (SV) systems typically exhibit performance degradation when enrollment and test utterances are spoken in different languages. However, standard evaluation protocols confound language mismatch with inter-speaker variability, as evaluation is generally performed with different speakers across languages.
In this work, we introduce a bilingual same-speaker evaluation set for five Iberian languages, enabling analysis of cross-lingual SV under constant speaker identity. We apply this setup to a HuBERT-based SV system previously shown to exhibit strong language dependence, and analyze results using the Cross-Lingual Transfer Matrix (CLTM) to study pairwise cross-lingual transfer.
Our results show that speaker-related variability accounts for part of the observed degradation, but language mismatch remains the main driver of cross-lingual performance loss. These findings provide a more precise characterization of language dependence in cross-lingual SV.
| Comments: | 5 pages, 8 figures, Submitted to IberSPEECH 2026 |
| Subjects: | Audio and Speech Processing (eess.AS); Computation and Language (cs.CL) |
| Cite as: | arXiv:2607.01161 [eess.AS] |
| (or arXiv:2607.01161v1 [eess.AS] for this version) | |
| https://doi.org/10.48550/arXiv.2607.01161 Focus to learn more arXiv-issued DOI via DataCite |
Submission history
From: Pol Buitrago [view email][v1] Wed, 1 Jul 2026 16:44:19 UTC (1,026 KB)
Full-text links:
Access Paper:
-
View a PDF of the paper titled Disentangling Speaker and Language Effects in Cross-Lingual Speaker Verification for Iberian Languages, by Pol Buitrago and Javier Hernando
- View PDF
- HTML (experimental)
- TeX Source
Current browse context:
eess.AS < prev | next >new | recent | 2026-07 Change to browse by: cs
cs.CL
eess
References & Citations
export BibTeX citation Loading...BibTeX formatted citation
× Data provided by:Bookmark
Bibliographic and Citation Tools
Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, MediaCode, Data and Media Associated with this Article
alphaXiv Toggle alphaXiv (What is alphaXiv?) Links to Code Toggle CatalyzeX Code Finder for Papers (What is CatalyzeX?) DagsHub Toggle DagsHub (What is DagsHub?) GotitPub Toggle Gotit.pub (What is GotitPub?) Huggingface Toggle Hugging Face (What is Huggingface?) ScienceCast Toggle ScienceCast (What is ScienceCast?) DemosDemos
Replicate Toggle Replicate (What is Replicate?) Spaces Toggle Hugging Face Spaces (What is Spaces?) Spaces Toggle TXYZ.AI (What is TXYZ.AI?) Related PapersRecommenders and Search Tools
Link to Influence Flower Influence Flower (What are Influence Flowers?) Core recommender toggle CORE Recommender (What is CORE?) About arXivLabsarXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)相关条目
92
精选OpenRouter 推出提示缓存与粘性路由,大幅降低多轮对话成本
对于高频调用 AI API 的开发者,这个功能堪称直接省钱利器。粘性路由保证了缓存命中率,配合 session_id 零配置接入,值得所有使用 OpenRouter 的团队立即尝试。
91
精选ChatGPT Work:可在跨应用和文件中执行操作的AI Agent
我认为这是AI助手从问答走向执行的关键一步。对需要自动化复杂工作流的专业人士尤其值得关注。ChatGPT Work可能成为生产力工具的新范式。
90
精选前沿实验室代理入侵事件技术时间线:2026年7月事件剖析
这篇技术时间线值得所有AI安全研究员和代理开发者细读——它不只是描述一次攻击,而是为整个行业敲响了代理系统防御体系薄弱的警钟。对正在部署自主代理的团队来说,这是必读的灾难预防手册。
90
精选更好的工具反而让Copilot代码审查更糟?GitHub这样改进
这篇博客值得所有AI产品工程师和ML从业者仔细阅读——它打破了'更强大的工具=更好的AI'的直觉,转而强调与Agent推理模式匹配的工程哲学。对正在优化代码审查或类似Agent产品的团队尤其重要。
88
精选OpenRouter 推出统一多模态 API:单端点支持图像、视频、音频、嵌入与转录
这条消息值得所有做多模态AI应用的开发者关注:OpenRouter用联合API解决了模型切换的痛点,特别适合初创团队或快速原型开发。如果你正被多个API密钥和SDK折磨,这个接口可能是你需要的统一层。
87
精选Anthropic 推出 Claude for Teachers:面向教师的教育 AI 工具
这条消息对教育工作者和AI行业观察者都很有价值。Anthropic没有选择通用聊天机器人,而是专门为教师设计了安全可控的工具,这显示出AI在垂直场景落地的正确思路——不是技术炫技,而是切实解决用户痛点。同时,产品内置的安全护栏也值得其他AI公司参考,尤其是在面向儿童或青少年的场景中。
86
精选OpenRouter发布全新Auto Router:用市场智慧优化模型路由
这条更新值得所有用API开发AI应用的人关注。以前选模型靠经验和测试,现在市场数据帮你选。虽然细节不多,但方向很对。对依赖聚合模型服务的团队尤其重要。
86
精选Claude Code v2.1.211 发布:多项修复与改进
作为一个经常使用 Claude Code 进行自动化编码的开发者,我特别关注这次的安全修复,尤其是权限预览字符绕过和自动模式覆盖钩子决策的问题——这些直接关系到团队协作时的安全边界。后台代理报告的改进也让长时间运行的任务更可靠。建议所有使用者尽快升级。