---
title: "层次经验贝叶斯朴素贝叶斯：极小极大平滑与AODE扩展"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2608.11162v1"
permalink: "https://feed.astralor.com/items/itm_29632cba257f47ccc74b6b15"
published: "2026-08-11T17:21:31.000Z"
score: 75
channel: "ai"
tags: ["AODE","HEB-NB","朴素贝叶斯","概率校准","经验贝叶斯","表格数据"]
---

# 层次经验贝叶斯朴素贝叶斯：极小极大平滑与AODE扩展

## AI 点评

> 这篇论文对机器学习研究者和工程者都有吸引力：自适应平滑解决了朴素贝叶斯长期存在的超参数难题，理论下界也增强了说服力。尤其适合处理高基数分类特征和概率校准场景的读者。

## 速览

论文提出层次经验贝叶斯朴素贝叶斯（HEB-NB），用第二类极大似然自适应学习Dirichlet先验浓度，替代固定强度平滑，兼顾跨类别信息共享与闭式推断。理论上证明其误差界匹配经验分布极小极大率，并与Laplace平滑严格分离；扩展HEB-AODE同样有效。在31个UCI/OpenML数据集上，HEB-NB平均排名最优，高基数数据对数损失降低至22.1%，结合互信息加权后top-1 ECE降低41%-70%。

## 关键点

- 提出HEB-NB，通过经验贝叶斯自适应学习Dirichlet先验浓度，替代固定平滑强度。
- 理论上证明非渐近ℓ1误差界匹配经验分布极小极大率，并与Laplace平滑严格分离。
- 扩展HEB-AODE，将自适应平滑推广到一阶依赖结构松弛，获得一致性能提升。
- 在31个UCI/OpenML基准上，高基数数据对数损失最多降低22.1%，top-1 ECE降低41%-70%。

## 全文

The Naive Bayes (NB) classifier remains a standard choice for categorical data, yet its widely used smoothing rules, such as Laplace, Lidstone, Krichevsky-Trofimov, and the $m$-estimate, all prescribe a fixed smoothing strength that ignores feature cardinality, sample size, and class imbalance, inducing a non-vanishing bias on modern high-cardinality tabular data. We propose hierarchical empirical-Bayes Naive Bayes (HEB-NB), in which each class-feature conditional probability is smoothed by a Dirichlet prior whose concentration is learned data-adaptively via Type-II maximum likelihood, enabling principled information sharing across classes while retaining closed-form inference. We further introduce HEB average one-dependence estimators (HEB-AODE), showing that the adaptive smoothing transfers cleanly to structural relaxations of NB. Theoretically, we establish a non-asymptotic $\ell_1$ error bound for HEB-NB matching the empirical-distribution minimax rate plus a vanishing data-adaptive bias, together with a matching Laplace-tight lower bound that yields a finite-sample, risk-level strict separation from Laplace. We further derive a plug-in excess Bayes-risk bound via total-variation tensorization and a population top-1 expected calibration error (ECE) corollary. Empirically, across 31 UCI and OpenML benchmarks, HEB-NB attains the best average Friedman rank on probabilistic metrics, with up to 22.1% log-loss reductions on high-cardinality datasets and consistent improvements of HEB-AODE over vanilla AODE. Combining HEB-NB with mutual-information weighting reduces top-1 ECE by 41%-70%, demonstrating substantial gains in probabilistic accuracy and calibration.

---

引用前请核对原文;本文由星际流动整理:https://feed.astralor.com/items/itm_29632cba257f47ccc74b6b15