Is possible to fine tune gguf models (Q4, Q8, Q5 …) models, just like PeftModel?
Federic
1
have you got any idea
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Fine tuning of ctransformers model | 0 | 153 | March 11, 2024 | |
| Fine Tuning GGML model | 3 | 3504 | September 24, 2023 | |
| Finetuned LLM model conversion to GGUF - performance drop | 4 | 2283 | July 31, 2024 | |
| Finetuing GPT model? | 2 | 406 | August 29, 2021 | |
| Hugging Face to GGUF Conversion Broken? | 1 | 5575 | February 11, 2024 |