GPTQ：GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers

arXiv · IST Austria, ETH Zurich, NeuralMagic

首个将千亿参数LLM在4小时内PTQ量化至3/4比特且几乎无损精度的高效二阶算法