Downloads · 30 days
11
16% of all-time downloads
auddin/llama3-8b-neris-validator
llama3-8b-neris-validator is a text generation model from auddin. Use it when you need the model to write or continue text. It is set up for peft.
from transformers import AutoModelForCausalLM, AutoTokenizer from peft import PeftModel
Downloads · 30 days
11
16% of all-time downloads
All-time downloads
67
Public
Repo size
265 MB
Likes
0
Public
Click a slice to open those files.
.safetensors168 MB · 91%
From the Hugging Face model README
from transformers import AutoModelForCausalLM, AutoTokenizer from peft import PeftModel
base_model = "meta-llama/Llama-3.1-8B-Instruct" adapter_model = "your-username/llama3-neris-auditor-lora"
tokenizer = AutoTokenizer.from_pretrained(adapter_model)
base = AutoModelForCausalLM.from_pretrained( base_model, torch_dtype="auto", device_map="auto" )