Downloads · 30 days
11
16% of all-time downloads
ashrafulparan/llama-3-finetuned-for-subjectivity-english-lora
llama-3-finetuned-for-subjectivity-english-lora is a zero-shot classification model from ashrafulparan. Use it when you need labels you did not train the model on. It is set up for peft. The card lists the license as apache-2.0.
It is a finetuned version of llama-3 for subjectivity dataset. It will output 1 for Subjectivity and 0 for Objectivity.
Downloads · 30 days
11
16% of all-time downloads
All-time downloads
68
Public
Repo size
168 MB
Likes
1
Public
Click a slice to open those files.
.safetensors168 MB · 100%
From the Hugging Face model README
It is a finetuned version of llama-3 for subjectivity dataset. It will output 1 for Subjectivity and 0 for Objectivity.
args = TrainingArguments(
per_device_train_batch_size = 2,
gradient_accumulation_steps = 4,
warmup_steps = 5,
num_train_epochs = 12,
learning_rate = 5e-5,
fp16 = not torch.cuda.is_bf16_supported(),
bf16 = torch.cuda.is_bf16_supported(),
logging_steps = 10,
optim = "adamw_8bit",
weight_decay = 0.001,
lr_scheduler_type = "linear",
seed = 3407,
output_dir = "outputs",
report_to = "none",)
<!-- Provide a longer summary of what this model is. -->
BibTeX:
[More Information Needed]