Downloads · 30 days
11
5% of all-time downloads
BornSaint/cabra-pt-br-3B_peft
cabra-pt-br-3B_peft is a machine learning model from BornSaint. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
this adapter model using (peft) was made on top of openlm-research/openllama3bv2 (https://huggingface.co/openlm-research/openllama3bv2)
Downloads · 30 days
11
5% of all-time downloads
All-time downloads
208
Public
Repo size
10.7 MB
Likes
0
Public
Click a slice to open those files.
.bin10.7 MB · 99%
From the Hugging Face model README
this adapter model using (peft) was made on top of openlm-research/open_llama_3b_v2 (https://huggingface.co/openlm-research/open_llama_3b_v2)
it's not perfect in portuguese, but in the perfect point to train a bit more for specific task in this language.
consider check the jupyter notebooks in the files section for more info.
these notebooks were get from web and are very similar to "cabrita" model, that was made on top of llama1.
trained in only 120 steps and with some results very similar to VMware/open-llama-13b-open-instruct
maybe necessary to adjust the parameters of inference to make it work better.