Why ML-Based Cough Models Do Not Generalize: A Systematic Cross-Dataset Evaluation for Tuberculosis Screening
Score
73首次系统揭示咳嗽声学模型跨数据集泛化失败的具体机制,填补了该领域外部验证研究的空白。
研究设计严谨,多数据集、多流水线对照,分析维度全面,结果呈现清晰。
对咳嗽筛查模型开发者提供明确的验证标准和设备多样性训练建议,可直接指导实践。
AI医疗落地需求紧迫,但该主题面向特定疾病领域,时效性中等。
arXiv预印本经作者团队多轮实验验证,数据和方法详实,但未经同行评审。
Base 81.5 × T2 Source weight ×0.9 = 73
Curation line 70Selected
Why selected
The study is rigorously designed with large-scale data, but the topic is niche to TB cough screening, with moderate impact on the broader AI community.
AI commentary
「This paper is a must-read for anyone working in medical AI audio analysis—it shatters the illusion that high internal accuracy is enough with a simple three-dataset validation. For teams building cough screening products, device diversity and external validation are not optional; they are a matter of survival.」
Quick overview
This paper systematically evaluates the cross-dataset generalizability of machine learning and deep learning cough-based tuberculosis screening classifiers across three independent datasets. Despite moderate within-dataset performance (ROC-AUC up to 0.755 ± 0.056), external performance frequently drops below 0.6, indicating models largely learn artifacts of recording devices and data collection rather than disease-related acoustic features. Audio representations cluster by device and dataset rather than TB status; device mismatch degrades transfer, while device-diverse training improves generalization. A clinical-variable baseline generalizes more consistently (ROC-AUC 0.655-0.711), suggesting acquisition-specific variability is a stronger driver of poor generalizability than population shift. The study emphasizes that external validation is essential before cough-based TB models are clinically ready.
- A systematic evaluation across three independent datasets shows that cough-based TB classifiers generalize poorly, with external ROC-AUC frequently below 0.6.
- Audio representations cluster by recording device and dataset rather than TB status, indicating models capture acquisition artifacts rather than disease signals.
- Device mismatch significantly degrades transfer, while device-diverse training improves generalization; a clinical-variable baseline outperforms acoustic models in stability.
- The study warns that high within-dataset performance is insufficient for clinical deployment; external validation is a necessary prerequisite.
Full text
This is an AI-generated Chinese digest; use "View original" for the source text.
Related items
FeaturedDeepSeek V4 Doubles Token Share on OpenRouter, Driven by Agentic Workloads
DeepSeek V4 在 OpenRouter 上的代币份额翻倍,智能体工作负载成主要驱动力
The rapid adoption of DeepSeek V4 signals a strong market preference for high-performance, low-cost inference models, especially as agentic use cases reshape AI deployment.
91
FeaturedEnabling Two Settings Triples ARC-AGI-3 Benchmark Scores
启用两项设置使ARC-AGI-3基准测试分数提升三倍
This finding is crucial! It shows that model performance depends not only on training but also on inference-time configuration. For AI engineers and researchers, this is a must-know optimization direction. Teams deploying models on resource-constrained devices in particular could find a low-cost way to boost capabilities.
91
FeaturedGPT-5.6: Fusing Frontier Intelligence with Frontier Efficiency
GPT-5.6:前沿智能与前沿效率的融合
This news is worth watching as it marks a shift from pure parameter scaling to efficiency competition. For AI developers and business decision-makers, GPT-5.6 means higher performance at lower cost, especially for long-context or agentic tasks previously hindered by inference expenses. OpenAI's move may redefine what 'frontier' means.
91
FeaturedLFM2.5-Encoders: New Models for Fast Long-Context Inference on CPU
LFM2.5-Encoder:面向CPU快速长上下文推理的新模型
This blog post catches my eye because it directly solves the pain point of running long-context LLMs on CPU. For teams or individual developers without high-end GPUs, the LFM2.5-Encoder series offers a ready-to-use open-source solution. Highly recommended for those working on RAG, document search, or code analysis—now a standard server can handle million-token documents.
91
FeaturedGPT-Red: OpenAI Automates Red Teaming via Self-Play to Boost Model Robustness
GPT-Red:OpenAI通过自我对弈实现AI红队自动化,提升模型鲁棒性
GPT-Red marks a milestone from human to automated red-teaming—essential for safety engineers and alignment researchers. While reducing cost, it also raises ethical questions about automated attacks, worth pondering for everyone in AI governance.
91
FeaturedOpenAI Launches GPT-5.5 Bio Bug Bounty Program
OpenAI推出GPT-5.5生物漏洞赏金计划
This program deserves attention as it pioneers the extension of AI bug bounty to biosecurity, offering a new research direction for the security community and a practical training ground for AI risk governance. It is particularly important for model safety researchers, biosecurity experts, and practitioners concerned about dual-use AI risks.
91
FeaturedvLLM Introduces Native-Speed Transformers Modeling Backend for Enhanced Inference Performance
vLLM推出原生速度Transformers建模后端,大幅提升推理性能
This update is critical for AI engineering teams: eliminating format conversion speeds up model iteration, and 2-5x speedup directly reduces GPU costs. If you're building LLM online services or batch inference, this is practically a must-read technical update.
90
FeaturedGoogle DeepMind Introduces SL2T, a Sign Language-to-Text Model for Deaf Users
Google DeepMind 发布手语转文本模型 SL2T,助力聋人用户
This news matters not only as a technical breakthrough but also as a sign that AI is beginning to address the needs of marginalized groups. For developers, the architecture and technical approach of SL2T merit deep study; for accessibility advocates, it's a key case for advancing industry standards.