SmoothQuant：SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

ICML · MIT, NVIDIA

通过数学等价的通道缩放将激活量化难度离线转移到权重，实现大模型无损高效的 W8A8 全整型矩阵乘推理。