LLM Quantization Review
This blog post provides an overview of the fundamental concepts of quantization, as well as a review of mainstream quantization methods in the context of LLMs.
Gptq
GPTQ Code Implementation
This blog post delved into the code implementation of the GPTQ quantization process, using the Llama model as a case study.
GPTQ Math Derivation
This blog post traces the development of GPTQ, starting from its roots in OBD, through OBS, and finally to OBC.