---
title: "Beyond Foundation Models: PFN Priors Improve Tabular Hyperparameter Optimization"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2611.05141v1"
permalink: "https://feed.astralor.com/items/itm_3ed33997345cf5340b407ad4"
published: "2026-11-03T16:20:15.000Z"
score: 58
channel: "tech"
tags: ["推理效率","Beyond Foundation Models","PFN Priors Improve","Tabular Hyperparameter Optimization","Synthetic","PriorTune","Offline","PFN"]
---

# Beyond Foundation Models: PFN Priors Improve Tabular Hyperparameter Optimization

## 速览

Synthetic priors have so far served one purpose: pretraining tabular foundation models. We ask whether the same priors can improve conventional tabular models, which are trained from scratch on each dataset. We propose …

## 关键点

- Synthetic priors have so far served one purpose: pretraining tabular foundation models.
- We ask whether the same priors can improve conventional tabular models, which are trained from scratch on each dataset.
- We propose PriorTune, a method that meta-tunes hyperparameter configurations on synthetic tasks alone.

## 全文

Synthetic priors have so far served one purpose: pretraining tabular foundation models. We ask whether the same priors can improve conventional tabular models, which are trained from scratch on each dataset. We propose PriorTune, a method that meta-tunes hyperparameter configurations on synthetic tasks alone. Offline, for a given model, we fit a pool of configurations on datasets sampled from a published PFN prior and greedily select the subset with the highest winrate over the random baseline. Online, a new dataset fits only the selected configurations, so the gain comes at no extra cost. Empirically, we observe that scaling both the number of configurations and synthetic datasets has an equal scaling effect on the performance of the final subset of configurations, which we also explain theoretically. On the full BeyondArena benchmark, LightGBM with TabPrep features with our configurations ranks above TabPFN-3 and RealMLP, while being much more efficient at inference. Overall, our results establish existing PFN priors as a scalable source of meta-training data for hyperparameter selection for non-foundational tabular models.

---

引用前请核对原文;本文由星际流动整理:https://feed.astralor.com/items/itm_3ed33997345cf5340b407ad4