Downloads · 30 days
0
bloom-6b4-clp-german-instruct-lora-peft
abdullahalzubaer/bloom-6b4-clp-german-instruct-lora-peft
bloom-6b4-clp-german-instruct-lora-peft is a text generation model from abdullahalzubaer. Use it when you need the model to write or continue text.
Github: https://github.com/abdullahalzubaer/bloom-6b4-clp-german-lora-inference
Access
Public
Updated May 11, 2023
Repo size
31.5 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin31.5 MB · 100%
At a glance
- Task
- Text Generation
- Access
- Public
- Created
- May 4, 2023
- Updated
- May 11, 2023
- SHA
- eb65a162
Model card
From the Hugging Face model README
Github: https://github.com/abdullahalzubaer/bloom-6b4-clp-german-lora-inference
Dataset used to train the adapter:
See this thread for more details https://huggingface.co/asprenger/bloom-6b4-clp-german-instruct-lora/discussions/2
- yizhongw/self_instruct [Translated to German]
- https://huggingface.co/datasets/yizhongw/self_instruct
This lora adapter is from https://huggingface.co/asprenger/bloom-6b4-clp-german-instruct-lora. Thanks for the adapter! I did not train it.
I thought I was uploading the complete bloom-6b4-clp-german model with the adapter that I made to work but then after pushing the model I realized that it was only the adapter. Still exploring how this PEFT works with LoRA works :)
strict requirments for peft
peft==0.2.0
requirment
pip install transformers accelerate bitsandbytes peft==0.2.0
latest peft has breaking changes with the bloom-6b4-clp-german and this lora adapter, and the only way to get them both work is (I think) is to train the base model or the adapter again (I am not sure yet).
Reference:
- Task
- Text Generation
- Languages
- de
- Created
- May 4, 2023
- Updated
- May 11, 2023