5 Commits

Author	SHA1	Message	Date
Antoni Baum	a10d3056da	[Core] Set linear_weights directly on the layer (#3977)	2024-04-11 16:35:51 -04:00
CHU Tianxiang	01a5d18a53	Add Support for 2/3/8-bit GPTQ Quantization Models (#2330)	2024-02-28 21:52:23 -08:00
Woosuk Kwon	6ef00b03a2	Enable CUDA graph for GPTQ & SqueezeLLM (#2318)	2024-01-03 09:52:29 -08:00
kliuae	1b7c791d60	[ROCm] Fixes for GPTQ on ROCm (#2180)	2023-12-18 10:41:04 -08:00
CHU Tianxiang	0fbfc4b81b	Add GPTQ support (#916)	2023-12-15 03:04:22 -08:00