Downloads · 30 days
0
samwit/bloompaca-7b1-lora
bloompaca-7b1-lora is a machine learning model from samwit. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is a LoRa finetuning of Bloom-7b1 using the Alpaca instruction dataset.
Downloads · 30 days
0
Access
Public
Updated Mar 18, 2023
Repo size
39.4 MB
Likes
0
Public
Click a slice to open those files.
.bin7.9 MB · 100%
From the Hugging Face model README
This is a LoRa finetuning of Bloom-7b1 using the Alpaca instruction dataset.
It really highlights how the Bloom models are undertrained with ~400M tokens as opposed to 1 Trillion in the smaller LLaMa models.