Downloads · 30 days
0
opt2.7B-de-lora
bjoernp/opt2.7B-de-lora
opt2.7B-de-lora is a machine learning model from bjoernp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as openrail.
This model was finetuned on 80000 examples from the german subset of the oscar corpus. See the git repo for more info and exact hyperparameters.
Access
Public
Updated Feb 20, 2023
Repo size
10.5 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin10.5 MB · 100%
At a glance
- Library
- transformers
- License
- openrail
- Access
- Public
- Created
- Feb 20, 2023
- Updated
- Feb 20, 2023
- SHA
- e6b730e2
Datasets
Model card
From the Hugging Face model README
OPT-2.7B finetuned on OSCAR with LoRA
This model was finetuned on 80000 examples from the german subset of the oscar corpus. See the git repo for more info and exact hyperparameters.
To run this model, simply instantiate the facebook/opt-2.7b model as per usual and activate the adapter with PEFT:
from peft import PeftModel, PeftConfig
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("facebook/opt-2.7b")
model = PeftModel.from_pretrained(model, "bjoernp/opt2.7B-de-lora")
Refer to the OPT Documentation for more infos on how to run the model and use the processor.
- Library
- transformers
- License
- openrail
- Languages
- de
- Created
- Feb 20, 2023
- Updated
- Feb 20, 2023