What is the difference between gptqConfig and bitsAndBytesConfig

abhi40308 August 27, 2023, 6:30am 1

Wanted to understand the difference between GPTQConfig and BitsAndBytesConfig

1 Like

Topic		Replies	Views
4-bit quantization Intermediate	0	489	November 18, 2023
Diff between GPTQ and NF4 with bitsandbytes 🤗Transformers	0	1296	August 1, 2023
Configuring Group Size for BitsAndBytesConfig 🤗Transformers	0	122	June 23, 2024
BitsAndBytesConfig is not compitable in TPU env 🤗Transformers	2	286	July 6, 2024
Quantization GPTQ 🤗Optimum	1	284	May 21, 2024