通过约束实现可控性:代码智能体可扩展监督的基础
评分
55精选理由
论文提出创新且实用的约束监督框架,实验数据充分,效果显著,直接解决当前AI代码生成的可控性与安全问题。
AI 点评
「该研究提供了一种低成本、可扩展的代码智能体监督方案,通过复用人类工程管理经验,有效缓解AI安全风险与审查瓶颈。」
速览
本文提出通过约束(如访问控制、网络策略、编码规范)来监督代码生成智能体,取代昂贵且不安全的无约束方案。实验表明,在Python代码库中检测后门时,使用约束基底可将召回率从54.5%提升至90.9%,且约束与工具贡献相互独立。该方法适用于语言保障较弱的场景(如Python),并可扩展到Rust等语言。
- 无约束代码智能体带来安全风险与代码库退化,人类审查成本剧增
- 传统工程管理约束(ACL、网络策略、编码规范)可直接迁移至智能体,且token成本更低
- 实验采用Gemma 4 e4b小型审查器,约束基底+200行脚本提升召回率至90.9%
- Python语言默认保证少,约束收益最大;原理可推广至Rust等强类型语言
正文
Computer Science > Artificial Intelligence
arXiv:2607.02389v1 (cs) [Submitted on 2 Jul 2026]Title:Steerability via constraints: a substrate for scalable oversight of coding agents
Authors:Thomas Winninger View a PDF of the paper titled Steerability via constraints: a substrate for scalable oversight of coding agents, by Thomas Winninger View PDFAbstract:Coding agents are capable; human oversight is the bottleneck. Unconstrained agents introduce security risks, erode codebase scalability, and make human review increasingly costly. We argue that the same methods used for decades to manage large human engineering teams: access control, network policies, strict coding conventions enforced by tooling; transfer directly to coding agents, and are cheaper (in token) than recent agentic scaffolding. We sketch a start-to-end system on this principle, and report a controlled experiment in scalable oversight: a small reviewer (Gemma 4 e4b) inspects a Python codebase containing 11 inserted backdoors. Recall rises from 54.5% (unconstrained, no tools) to 90.9% (constrained substrate plus a ~200-LoC `docs` CLI), with substrate and tools contributing independently. We choose Python deliberately: substrate-level oversight gains are largest where the language gives the fewest guarantees by default; the principles extend to languages like Rust.
| Comments: | Accepted to the Deep Learning for Code Workshop at the 43rd International Conference on Machine Learning, Seoul, South Korea, 2026 |
| Subjects: | Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Software Engineering (cs.SE) |
| Cite as: | arXiv:2607.02389 [cs.AI] |
| (or arXiv:2607.02389v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2607.02389 Focus to learn more arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Thomas Winninger [view email][v1] Thu, 2 Jul 2026 16:24:47 UTC (339 KB)
Full-text links:
Access Paper:
-
View a PDF of the paper titled Steerability via constraints: a substrate for scalable oversight of coding agents, by Thomas Winninger
- View PDF
Current browse context:
cs.AI < prev | next >new | recent | 2026-07 Change to browse by: cs
cs.CR
cs.SE
References & Citations
export BibTeX citation Loading...BibTeX formatted citation
× Data provided by:Bookmark
Bibliographic and Citation Tools
Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, MediaCode, Data and Media Associated with this Article
alphaXiv Toggle alphaXiv (What is alphaXiv?) Links to Code Toggle CatalyzeX Code Finder for Papers (What is CatalyzeX?) DagsHub Toggle DagsHub (What is DagsHub?) GotitPub Toggle Gotit.pub (What is GotitPub?) Huggingface Toggle Hugging Face (What is Huggingface?) ScienceCast Toggle ScienceCast (What is ScienceCast?) DemosDemos
Replicate Toggle Replicate (What is Replicate?) Spaces Toggle Hugging Face Spaces (What is Spaces?) Spaces Toggle TXYZ.AI (What is TXYZ.AI?) Related PapersRecommenders and Search Tools
Link to Influence Flower Influence Flower (What are Influence Flowers?) Core recommender toggle CORE Recommender (What is CORE?) About arXivLabsarXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)相关条目
92
精选OpenRouter 推出提示缓存与粘性路由,大幅降低多轮对话成本
对于高频调用 AI API 的开发者,这个功能堪称直接省钱利器。粘性路由保证了缓存命中率,配合 session_id 零配置接入,值得所有使用 OpenRouter 的团队立即尝试。
91
精选ChatGPT Work:可在跨应用和文件中执行操作的AI Agent
我认为这是AI助手从问答走向执行的关键一步。对需要自动化复杂工作流的专业人士尤其值得关注。ChatGPT Work可能成为生产力工具的新范式。
90
精选前沿实验室代理入侵事件技术时间线:2026年7月事件剖析
这篇技术时间线值得所有AI安全研究员和代理开发者细读——它不只是描述一次攻击,而是为整个行业敲响了代理系统防御体系薄弱的警钟。对正在部署自主代理的团队来说,这是必读的灾难预防手册。
90
精选更好的工具反而让Copilot代码审查更糟?GitHub这样改进
这篇博客值得所有AI产品工程师和ML从业者仔细阅读——它打破了'更强大的工具=更好的AI'的直觉,转而强调与Agent推理模式匹配的工程哲学。对正在优化代码审查或类似Agent产品的团队尤其重要。
88
精选OpenRouter 推出统一多模态 API:单端点支持图像、视频、音频、嵌入与转录
这条消息值得所有做多模态AI应用的开发者关注:OpenRouter用联合API解决了模型切换的痛点,特别适合初创团队或快速原型开发。如果你正被多个API密钥和SDK折磨,这个接口可能是你需要的统一层。
87
精选Anthropic 推出 Claude for Teachers:面向教师的教育 AI 工具
这条消息对教育工作者和AI行业观察者都很有价值。Anthropic没有选择通用聊天机器人,而是专门为教师设计了安全可控的工具,这显示出AI在垂直场景落地的正确思路——不是技术炫技,而是切实解决用户痛点。同时,产品内置的安全护栏也值得其他AI公司参考,尤其是在面向儿童或青少年的场景中。
86
精选OpenRouter发布全新Auto Router:用市场智慧优化模型路由
这条更新值得所有用API开发AI应用的人关注。以前选模型靠经验和测试,现在市场数据帮你选。虽然细节不多,但方向很对。对依赖聚合模型服务的团队尤其重要。
86
精选Claude Code v2.1.211 发布:多项修复与改进
作为一个经常使用 Claude Code 进行自动化编码的开发者,我特别关注这次的安全修复,尤其是权限预览字符绕过和自动模式覆盖钩子决策的问题——这些直接关系到团队协作时的安全边界。后台代理报告的改进也让长时间运行的任务更可靠。建议所有使用者尽快升级。