Downloads · 30 days
10
28% of all-time downloads
Suryanshg/Classification-DoD-translator
Classification-DoD-translator is a text generation model from Suryanshg. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as llama3.1.
LoRA adapter that translates soft prompt embeddings into natural-language task instructions. Part of the "Learning to Translate from Soft to Hard LLM Prompts" project.
Downloads · 30 days
10
28% of all-time downloads
All-time downloads
36
Public
Repo size
59.2 MB
Likes
0
Public
Click a slice to open those files.
.safetensors42 MB · 71%
From the Hugging Face model README
LoRA adapter that translates soft prompt embeddings into natural-language task instructions. Part of the "Learning to Translate from Soft to Hard LLM Prompts" project.
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base_model = AutoModelForCausalLM.from_pretrained(
"meta-llama/Llama-3.1-8B-Instruct", torch_dtype="auto", device_map="auto",
)
model = PeftModel.from_pretrained(base_model, "<path-to-adapter>")
tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-3.1-8B-Instruct")
| Parameter | Value |
|---|---|
| Base model | meta-llama/Llama-3.1-8B-Instruct |
| LoRA rank | 4 |
| LoRA alpha | 8 |
| Dropout | 0.1 |
| Target modules | down_proj, gate_proj, k_proj, up_proj, v_proj, o_proj, q_proj |
| PEFT version | 0.18.0 |
Built with Llama.
Llama 3.1 is licensed under the Llama 3.1 Community License, Copyright © Meta Platforms, Inc. All Rights Reserved.