Quantization & Compression

INT8, INT4, GPTQ, AWQ, and the precision-accuracy tradeoff in production systems.