EAGLE:EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty

ICML · Peking University, Microsoft Research, U

在特征层进行自回归并引入错位Token消除采样不确定性,以极低训练成本实现2.7~3.5倍的无损推理加速。

arXiv:2401.15077