评分 5.5 · 来源：cs.CL updates on arXiv.org · 发布于 2026-04-17
评分依据：Extends speculative decoding to multi-step verification, novel combination of spec decoding with verification
arXiv:2604.15244v1 Announce Type: new Abstract: Speculative decoding (SD) accelerates large language model inference by allowing a lightweight draft model to propose outputs that a stronger target model verifies. However, its token-centric nature allows erroneous steps to propagate. Prior approaches mitigate this using external reward models, but incur additional latency, computational overhead, and limit generalizability. We propose SpecGuard, a verification-aware speculative decoding framework that performs step-level verification using only model-internal signals.