---
title: "Presentation Sensitivity in Typed Decision Models for Subjective Text Evaluation"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2611.06384v1"
permalink: "https://feed.astralor.com/items/itm_2fa9e8699f708e68b3d850c6"
published: "2026-11-04T11:48:58.000Z"
score: 58
channel: "tech"
tags: ["推理效率","安全","Presentation Sensitivity","Typed Decision Models","Subjective Text Evaluation","Typed","Jev","Clef Flash"]
---

# Presentation Sensitivity in Typed Decision Models for Subjective Text Evaluation

## At a glance

Typed decision models offer structured choices, scores, and probabilities for low-cost automated evaluation. We present a controlled audit of presentation sensitivity in Jev, Clef Flash, and Perplexity Decider across na…

## Key points

- Typed decision models offer structured choices, scores, and probabilities for low-cost automated evaluation.
- We present a controlled audit of presentation sensitivity in Jev, Clef Flash, and Perplexity Decider across native choice and score interfaces.
- Across six datasets with 9,000 multiply annotated humor, helpfulness, and summarization items, we collect 702,000 judgments under interventions that vary positions, identifiers, authorship claims, endorsements, decision…

## Full text

Typed decision models offer structured choices, scores, and probabilities for low-cost automated evaluation. We present a controlled audit of presentation sensitivity in Jev, Clef Flash, and Perplexity Decider across native choice and score interfaces. Across six datasets with 9,000 multiply annotated humor, helpfulness, and summarization items, we collect 702,000 judgments under interventions that vary positions, identifiers, authorship claims, endorsements, decision framing, and rating rubrics while preserving the evaluated texts. Jev's second-position probability advantage reaches 6.11 percentage points on summaries; reversing reader endorsements changes Perplexity's selected humor text on 40.40% of pairs; and rejection framing reduces Clef's summary agreement with human preferences by 23.36 points. Rating formats also shift score levels while often preserving rankings. Across these findings, repeatability, presentation robustness, and human alignment emerge as distinct properties of an evaluator. Reliable use therefore requires validating the decisions and score interpretations on which an evaluation pipeline depends.

---

Verify against the original before citing; curated by Astral Feed: https://feed.astralor.com/items/itm_2fa9e8699f708e68b3d850c6