---
title: "ElTab: Elastically Looped Tabular Transformers"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2610.41819v1"
permalink: "https://feed.astralor.com/items/itm_3c81ce586543da98cabf82fa"
published: "2026-10-30T14:39:37.000Z"
score: 53
channel: "tech"
tags: ["推理效率","RAG","多模态","ElTab","Elastically Looped Tabular","Transformers Tabular","TabPFN","While"]
---

# ElTab: Elastically Looped Tabular Transformers

## 速览

Tabular transformer models such as TabPFN achieve strong predictive performance but incur substantial inference costs, making them difficult to deploy in resource-constrained settings. While looped transformers reduce p…

## 关键点

- Tabular transformer models such as TabPFN achieve strong predictive performance but incur substantial inference costs, making them difficult to deploy in resource-constrained settings.
- While looped transformers reduce parameter count through weight sharing, they can lose significant predictive power when stopped early.
- To address this challenge, we introduce the Elastically Looped Tabular Transformer (ElTab), a single model trained to operate across different computational budgets through supervision at randomly sampled early exits.

## 全文

Tabular transformer models such as TabPFN achieve strong predictive performance but incur substantial inference costs, making them difficult to deploy in resource-constrained settings. While looped transformers reduce parameter count through weight sharing, they can lose significant predictive power when stopped early. To address this challenge, we introduce the Elastically Looped Tabular Transformer (ElTab), a single model trained to operate across different computational budgets through supervision at randomly sampled early exits. Across 30 OpenML classification datasets, a single ElTab model matches six depth-specific looped models while cutting training cost by more than half, and matches a 12-layer TabPFN-style baseline with 25% fewer inference FLOPs. These results show that elastic-depth training yields a single model that adapts to the deployment budget at hand, offering a favorable trade-off among predictive performance, storage, and computational cost.

---

引用前请核对原文;本文由星际流动整理:https://feed.astralor.com/items/itm_3c81ce586543da98cabf82fa