---
title: "Timbre: Reliability-aware harmonic consensus for label-free multimodal test-time rexinforcement learning"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2610.39439v1"
permalink: "https://feed.astralor.com/items/itm_0cf8ea4146257daf36fe9bfd"
published: "2026-10-29T06:15:35.000Z"
score: 57
channel: "tech"
tags: ["RAG","多模态","Timbre","Reliability-aware","Label-free","However","Cross-view","Across"]
---

# Timbre: Reliability-aware harmonic consensus for label-free multimodal test-time rexinforcement learning

## 速览

Label-free test-time reinforcement learning adapts vision--language models using rewards derived from their own predictions. However, misinterpreted visual evidence and sensitivity to textual formulation can produce a c…

## 关键点

- Label-free test-time reinforcement learning adapts vision--language models using rewards derived from their own predictions.
- However, misinterpreted visual evidence and sensitivity to textual formulation can produce a consistent but incorrect consensus that majority voting reinforces.
- Cross-view aggregation can expose such errors, but image and text transformations may themselves degrade task-relevant evidence to different extents.

## 全文

Label-free test-time reinforcement learning adapts vision--language models using rewards derived from their own predictions. However, misinterpreted visual evidence and sensitivity to textual formulation can produce a consistent but incorrect consensus that majority voting reinforces. Cross-view aggregation can expose such errors, but image and text transformations may themselves degrade task-relevant evidence to different extents. We introduce \method, a reliability-aware harmonic consensus framework for multimodal test-time reinforcement learning. \method constructs a $2\times2$ grid combining original and perturbed images with direct-solving and reframing modes, selects pseudo-labels through weighted harmonic aggregation, and adapts modality-level weights using batch-averaged, temporally smoothed shifts in pseudo-label confidence as a heuristic reliability signal. We formulate consensus as a weighted $χ^2$-barycenter problem whose unique minimizer is the normalized weighted harmonic aggregate, without requiring correct-answer invariance. An exact support--dispersion decomposition characterizes when harmonic aggregation preserves or corrects arithmetic rankings, while a sensitivity analysis establishes how modality reweighting changes pairwise ranking margins, informing interpretation of the heuristic updates. Across six benchmarks and three Qwen3-VL model scales, \method outperforms TTRV in 16 of 18 benchmark--model settings on adaptation instances and 17 of 18 settings on held-out instances under matched estimation and optimization rollout counts. These results demonstrate improved target-task adaptation and transfer to unseen instances without further updates.

---

引用前请核对原文;本文由星际流动整理:https://feed.astralor.com/items/itm_0cf8ea4146257daf36fe9bfd