---
title: "S1CogBench: What System One Decision Models Can and Cannot Do on Cognitive Experiments"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2611.00911v1"
permalink: "https://feed.astralor.com/items/itm_6298871a7e2fbff49c1a9311"
published: "2026-10-31T13:09:19.000Z"
score: 55
channel: "ai"
tags: ["多模态","S1CogBench","What System One","Decision Models Can","Cannot","Cognitive Experiments Language","Software","System One"]
---

# S1CogBench: What System One Decision Models Can and Cannot Do on Cognitive Experiments

## 速览

Language models are no longer used only to generate text. Software also asks them for decisions, in routing, guardrails, and automated gates. System One decision models, also called typed decision models, such as Jev an…

## 关键点

- Language models are no longer used only to generate text.
- Software also asks them for decisions, in routing, guardrails, and automated gates.
- System One decision models, also called typed decision models, such as Jev and Laya, return one fast decision over the legal options, leaving no text to inspect.

## 全文

Language models are no longer used only to generate text. Software also asks them for decisions, in routing, guardrails, and automated gates. System One decision models, also called typed decision models, such as Jev and Laya, return one fast decision over the legal options, leaving no text to inspect. However, a fast, well-formed decision does not show that the model used the evidence. Cognitive experiments can test this, because they vary task demands and measure how behavior changes, yet existing cognitive benchmarks evaluate language and multimodal models. We introduce S1CogBench to ask what these models can and cannot do on 24 cognitive tasks, evaluating five open models and Jev and keeping conditions and scoring apart from disclosed adaptations. We find that decision models vary widely in reliability, acting well does not imply predicting humans, aggregate scores hide how decisions respond to conditions, and speed comes mainly from answering without generation. To our knowledge, S1CogBench is the first benchmark of System One decision models on established cognitive experiments, and it gives a shared test of whether their decisions respond to evidence, feedback, memory load, and future opportunities before software relies on them.

---

引用前请核对原文;本文由星际流动整理:https://feed.astralor.com/items/itm_6298871a7e2fbff49c1a9311