Downloads · 30 days
0
wmt-switch-base-64-lora-ckpt30000
marsggbo/wmt-switch-base-64-lora-ckpt30000
wmt-switch-base-64-lora-ckpt30000 is a machine learning model from marsggbo. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
Lora weights after finetuning Switch-base-64 on WMT16 datasets.
Access
Public
Updated Sep 20, 2024
Repo size
107 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors107 MB · 100%
At a glance
- Library
- transformers
- Access
- Public
- Created
- Jun 17, 2024
- Updated
- Sep 20, 2024
- SHA
- f962c4af
Model card
From the Hugging Face model README
Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->Lora weights after finetuning Switch-base-64 on WMT16 datasets.
To use Lora weights
from peft import PeftModel
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
base_model = AutoModelForSeq2SeqLM.from_pretrained('google/switch-base-64', use_safetensors=False)
lora_model = PeftModel.from_pretrained(base_model, 'marsggbo/wmt-switch-base-64-lora-ckpt30000')
merged_model = lora_model.merge_and_unload()
merged_model.save_pretrained('./switch-base-64-wmt', state_dict=merged_model.state_dict(), safe_serialization=False)
To use merged model weights
model = AutoModelForSeq2SeqLM.from_pretrained('./switch-base-64-wmt')
- Library
- transformers
- Created
- Jun 17, 2024
- Updated
- Sep 20, 2024