Activation and Floating-Point Quantization
Overview This post is divided into three parts; they are: • Why Activations Are Hard to Quantize • W8A8 Inference and SmoothQuant • Floating-Point Quantization Why Activations Are Hard to Quantize
We haven't written up this one. Machine Learning Mastery has the full story — the link below goes straight to it.