---
title: "自我认证利用行为的智能体：面向安全对手利用的置信调度受限响应"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2607.28520v1"
permalink: "https://feed.astralor.com/items/itm_c8fb3bf8d9893ff13cede7ea"
published: "2026-07-30T16:57:57.000Z"
score: 77
channel: "ai"
tags: ["CS-RNR","Leduc扑克","安全强化学习","对手利用","置信序列"]
---

# 自我认证利用行为的智能体：面向安全对手利用的置信调度受限响应

## AI 点评

> 这篇论文最吸引我的是'自我审计'的思想：让智能体在行动前就为每次利用算好安全证书，而不是事后补救。如果你是研究博弈论或安全RL的工程师，这套预算约束下的受限响应框架值得借鉴。

## 速览

在二人零和不完全信息博弈中，纳什均衡策略虽保证游戏价值，却放弃利用对手缺陷。我们提出预算受限的置信调度受限响应（CS-RNR），其安全保证是智能体在实际部署策略上计算的证书，确保每次利用都经自我审计。该方法用随时有效置信序列跟踪动作频率，仅当区间与均衡参考分离时视为可利用，构建保守对手模型并生成候选反策略，部署前验证全部候选，并与预算原子化比较。在Leduc扑克等游戏中，CS-RNR在预算内显著提升稳态收益，所有手牌审计通过。

## 关键点

- 提出CS-RNR方法，安全证书基于实际部署策略计算，确保利用行为经过自我审计。
- 使用随时有效置信序列识别可利用动作频率，保守建模对手并生成候选反策略。
- 在Leduc hold'em中，CS-RNR获得6.2倍于二元门控的稳态收益，轨迹混合达13.6倍，同时全部策略保持预算内。
- 在多种博弈中36000手审计均满足容差，证明其安全保证的可靠性。

## 全文

An agent playing a Nash-equilibrium strategy in a two-player zero-sum imperfect-information game secures the game value but forfeits the additional value offered by a flawed opponent. Diffuse deviations pose a particular challenge: binary release rules may gather too little evidence to act, while a full best response to an incomplete opponent model can be highly exploitable. We introduce \emph{budget-constrained confidence-scheduled restricted responses} (CS-RNR), the first opponent-exploitation method whose safety guarantee is a certificate the agent computes on the strategy it actually deploys, so that every exploit it commits to is one it has audited itself. The method tracks pooled action frequencies with anytime-valid confidence sequences and treats a frequency as exploitable only once its interval separates from an equilibrium reference. The confirmed deviations define a conservative opponent model, which a restricted-response solve turns into candidate counter-strategies over a grid of pin levels. Before deployment, each complete candidate is evaluated by a full-tree best response. The resulting certificate is compared with a user-specified budget and committed atomically with the strategy. Because this check is performed on the played strategy, model quality determines the exploitation achieved while the certificate controls reference-relative expected loss. In Leduc hold'em, CS-RNR obtains $6.2\times$ the steady-state gain of a money-verified binary gate while keeping every deployed strategy within budget. A trajectory mixture using the same estimator reaches $13.6\times$ the budget. Across Leduc, Liar's Dice, and 5-rank Leduc, all $36{,}000$ audited hands satisfy the reported certificate tolerance.

---

引用前请核对原文;本文由星际流动整理:https://feed.astralor.com/items/itm_c8fb3bf8d9893ff13cede7ea