Awq

This blog post provides an overview of the fundamental concepts of quantization, as well as a review of mainstream quantization methods in the context of LLMs.

This blog post compares SmoothQuant and AWQ differences and their code implementation.