Definition
Quantization is a technique that reduces compute and memory by representing model weights with lower bit-width numbers, making inference faster and cheaper. It can trade a small accuracy drop for efficiency gains.
量子化
Definition
Quantization is a technique that reduces compute and memory by representing model weights with lower bit-width numbers, making inference faster and cheaper. It can trade a small accuracy drop for efficiency gains.