分阶段混合:通过知识蒸馏实现视觉量子强化学习
评分
56精选理由
方法创新性高(分阶段蒸馏+紧凑头),实验设计完整且对比充分,但振幅编码头的脆弱性限制了实际部署。
AI 点评
「该工作为在资源受限的量子硬件上训练视觉控制策略提供了实用方法,突破了端到端QRL的瓶颈。」
速览
本研究提出分阶段知识蒸馏策略解决视觉量子强化学习难题。先训练经典视觉教师网络,冻结其编码器作为特征接口,再将策略行为蒸馏至紧凑的下游头(经典或VQC)。在CartPole Pixels和Acrobot Pixels环境中的实验表明,浅层VQC头能习得非平凡视觉控制行为,角度编码VQC头性能接近教师,振幅编码头极度紧凑但更脆弱。该方法将视觉QRL转化为紧凑头学习问题,为在标准端到端循环外训练小型量子兼容策略提供了实用路径。
- 分阶段知识蒸馏避免了端到端训练视觉量子网络的困难,通过先训练经典教师再蒸馏策略到紧凑下游头。
- 冻结的教师编码器作为特征接口,使基于VQC的学生在相同表示下与经典控制公平比较。
- 角度编码VQC头在保持紧凑的同时性能接近教师,而振幅编码头极度紧凑但易受预算和仿真时间影响。
正文
Quantum Physics
arXiv:2606.30520v1 (quant-ph) [Submitted on 29 Jun 2026]Title:Staged Hybridisation for Visual Quantum Reinforcement Learning via Knowledge Distillation
Authors:Javier Lazaro, Juan-Ignacio Vazquez, Pablo Garcia-Bringas View a PDF of the paper titled Staged Hybridisation for Visual Quantum Reinforcement Learning via Knowledge Distillation, by Javier Lazaro and 2 other authors View PDF HTML (experimental)Abstract:Visual environments are a demanding setting for quantum reinforcement learning (QRL): high-dimensional observations, unstable RL optimisation, and constrained variational quantum circuits (VQCs) are difficult to train jointly. This paper studies knowledge distillation (KD) as a staged hybridisation strategy for visual QRL. Instead of training a hybrid visual agent end-to-end from pixels, we first train a classical visual teacher, freeze its encoder as a feature interface, and distil the teacher's policy behaviour into compact downstream heads. These heads can be classical or VQC-based, enabling small quantum-compatible students to be evaluated under the same frozen representation as compact classical controls.
We evaluate the pipeline on CartPole Pixels and Acrobot Pixels. The results show that staged KD enables shallow VQC heads to acquire non-trivial visual-control behaviour in settings where direct pixel-based training would be substantially more difficult. Angle-encoded VQC heads retain near-teacher performance, while amplitude-encoded heads push compactness to an extreme regime, at the cost of greater fragility, stronger budget sensitivity, and higher simulation time. Overall, staged KD reframes visual QRL as a compact-head learning problem, opening a practical route for training small quantum-compatible policies outside the standard end-to-end RL loop.
| Subjects: | Quantum Physics (quant-ph); Machine Learning (cs.LG) |
| Cite as: | arXiv:2606.30520 [quant-ph] |
| (or arXiv:2606.30520v1 [quant-ph] for this version) | |
| https://doi.org/10.48550/arXiv.2606.30520 Focus to learn more arXiv-issued DOI via DataCite |
Submission history
From: Javier Lazaro [view email][v1] Mon, 29 Jun 2026 16:28:57 UTC (641 KB)
Full-text links:
Access Paper:
-
View a PDF of the paper titled Staged Hybridisation for Visual Quantum Reinforcement Learning via Knowledge Distillation, by Javier Lazaro and 2 other authors
- View PDF
- HTML (experimental)
- TeX Source
Current browse context:
quant-ph < prev | next >new | recent | 2026-06 Change to browse by: cs
cs.LG
References & Citations
export BibTeX citation Loading...BibTeX formatted citation
× Data provided by:Bookmark
Bibliographic and Citation Tools
Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, MediaCode, Data and Media Associated with this Article
alphaXiv Toggle alphaXiv (What is alphaXiv?) Links to Code Toggle CatalyzeX Code Finder for Papers (What is CatalyzeX?) DagsHub Toggle DagsHub (What is DagsHub?) GotitPub Toggle Gotit.pub (What is GotitPub?) Huggingface Toggle Hugging Face (What is Huggingface?) ScienceCast Toggle ScienceCast (What is ScienceCast?) DemosDemos
Replicate Toggle Replicate (What is Replicate?) Spaces Toggle Hugging Face Spaces (What is Spaces?) Spaces Toggle TXYZ.AI (What is TXYZ.AI?) Related PapersRecommenders and Search Tools
Link to Influence Flower Influence Flower (What are Influence Flowers?) Core recommender toggle CORE Recommender (What is CORE?) About arXivLabsarXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)相关条目
92
精选OpenRouter 推出提示缓存与粘性路由,大幅降低多轮对话成本
对于高频调用 AI API 的开发者,这个功能堪称直接省钱利器。粘性路由保证了缓存命中率,配合 session_id 零配置接入,值得所有使用 OpenRouter 的团队立即尝试。
91
精选ChatGPT Work:可在跨应用和文件中执行操作的AI Agent
我认为这是AI助手从问答走向执行的关键一步。对需要自动化复杂工作流的专业人士尤其值得关注。ChatGPT Work可能成为生产力工具的新范式。
90
精选前沿实验室代理入侵事件技术时间线:2026年7月事件剖析
这篇技术时间线值得所有AI安全研究员和代理开发者细读——它不只是描述一次攻击,而是为整个行业敲响了代理系统防御体系薄弱的警钟。对正在部署自主代理的团队来说,这是必读的灾难预防手册。
90
精选更好的工具反而让Copilot代码审查更糟?GitHub这样改进
这篇博客值得所有AI产品工程师和ML从业者仔细阅读——它打破了'更强大的工具=更好的AI'的直觉,转而强调与Agent推理模式匹配的工程哲学。对正在优化代码审查或类似Agent产品的团队尤其重要。
88
精选OpenRouter 推出统一多模态 API:单端点支持图像、视频、音频、嵌入与转录
这条消息值得所有做多模态AI应用的开发者关注:OpenRouter用联合API解决了模型切换的痛点,特别适合初创团队或快速原型开发。如果你正被多个API密钥和SDK折磨,这个接口可能是你需要的统一层。
87
精选Anthropic 推出 Claude for Teachers:面向教师的教育 AI 工具
这条消息对教育工作者和AI行业观察者都很有价值。Anthropic没有选择通用聊天机器人,而是专门为教师设计了安全可控的工具,这显示出AI在垂直场景落地的正确思路——不是技术炫技,而是切实解决用户痛点。同时,产品内置的安全护栏也值得其他AI公司参考,尤其是在面向儿童或青少年的场景中。
86
精选OpenRouter发布全新Auto Router:用市场智慧优化模型路由
这条更新值得所有用API开发AI应用的人关注。以前选模型靠经验和测试,现在市场数据帮你选。虽然细节不多,但方向很对。对依赖聚合模型服务的团队尤其重要。
86
精选Claude Code v2.1.211 发布:多项修复与改进
作为一个经常使用 Claude Code 进行自动化编码的开发者,我特别关注这次的安全修复,尤其是权限预览字符绕过和自动模式覆盖钩子决策的问题——这些直接关系到团队协作时的安全边界。后台代理报告的改进也让长时间运行的任务更可靠。建议所有使用者尽快升级。