How to merge LoRa weights with base model?

🤗Transformers
1

Is it possible to merge LoRa adapter weights with a base model like Bloomz?

2 Likes