Downloads · 30 days
13
22% of all-time downloads
LLAMA3-MED-v2.2
rhyliieee/LLAMA3-MED-v2.2
LLAMA3-MED-v2.2 is a text generation model from rhyliieee. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Finetuned a pretrained Model with Lora, resize the base model's embeddings, then load Peft Model with the resized base model.
All-time downloads
60
Public
Parameters
4.7B
5.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.7 GB · 100%
Parameter types
How the weights are stored.
U83.6B · 77%
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Finetuned a pretrained Model with Lora, resize the base model's embeddings, then load Peft Model with the resized base model.
"""
add special tokens to the tokenizer and base model before merging peft with base
open_tokenizer.add_special_tokens({ "additional_special_tokens": ["<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"] }) base_model.resize_token_embeddings(len(open_tokenizer))
reload the peft model with resized token embedding of base model
peft_model = PeftModel.from_pretrained(base_model, "rhyliieee/LLaMA3-8Bit-Lora-Med-v2",)
perform merging
merged_peft_base_with_special_tokens = peft_model.merge_and_unload() """
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Created
- Nov 2, 2024
- Updated
- Nov 2, 2024