SmoothQuant / LLM.int8()
INT8 methods that handle activation outliers so 8-bit quantization stays accurate.
INT8 methods that handle activation outliers so 8-bit quantization stays accurate.
INT8 methods that handle activation outliers so 8-bit quantization stays accurate.
INT8 methods that handle activation outliers so 8-bit quantization stays accurate.