GPTQModel
Repository: GPTQModel
Author: ModelCloud · Source status: Clear source
LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.
Score basis:Clear source · Risk needs review · Universal