---
title: "面向互信息估计的多元全面基准测试框架"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2607.03487v1"
permalink: "https://feed.astralor.com/items/itm_56adf7b6247dd18e98929e70"
published: "2026-07-03T16:55:55.000Z"
score: 76
channel: "ai"
tags: ["Copula理论","互信息估计","因果推断","基准测试","表示学习"]
---

# 面向互信息估计的多元全面基准测试框架

## AI 点评

> 这篇论文颠覆了“某类估计器总是最好”的直觉，对于从事表示学习、因果发现或信息论研究的AI从业者，是一个必须关注的基准。作者以copula视角建立统一框架，值得反复咀嚼。开源代码让复现和扩展变得可行。

## 速览

互信息估计是机器学习和统计学的核心问题，但现有基准测试多局限于简化低维分布。本文基于copula理论提出统一基准框架，包含“copula先验”和“边缘先验”两类测试族，系统评估非参数、判别式和生成式三类估计器。实验表明不存在全能胜者，不同设置下各类估计器可能表现最优，并揭示了关键估计瓶颈。

## 关键点

- 基于copula理论统一了现有互信息估计基准，并提出两类新测试族。
- 系统评估非参数、判别式和生成式三类估计器，发现无通用最优方法。
- 分析性能差异，识别出关键的估计瓶颈，并提出针对性压力测试。

## 全文

Mutual information (MI) estimation is a central problem in machine learning and statistics; however, existing benchmarks typically evaluate estimators on simplified, low-dimensional distributions, leaving their performance on complex, realistic data largely unexplored. We address this gap with a comprehensive benchmarking framework grounded in a unified copula-theoretic perspective that subsumes existing benchmarks as special cases. Within this framework, we propose two complementary families of tests: a copula-first family that systematically varies ground-truth MI, dimensionality, and marginal complexity using synthetic and flow-based transformations; and a marginals-first family that couples real-world image data with controlled dependency structures, extending the classic same-class-pairing paradigm. We use this suite to extensively evaluate three classes of estimators: non-parametric, discriminative, and generative. Contrary to prevailing assumptions, our results indicate that there is no universal winner: each category can systematically outperform all other estimators under specific setups. By analyzing these cases, we identify fundamental estimation barriers and propose new tests that more effectively stress these specific limitations. We share the open source code at https://github.com/VanessB/mutinfo.

---

引用前请核对原文;本文由星际流动整理:https://feed.astralor.com/items/itm_56adf7b6247dd18e98929e70