Downloads · 30 days
97
3% of all-time downloads
RichardErkhov/Na0s_-_Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-gguf
Na0s_-_Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
97
3% of all-time downloads
All-time downloads
2.8K
Public
Repo size
80.6 GB
Likes
0
Public
Click a slice to open those files.
.gguf93.3 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT - GGUF
library_name: transformers license: apache-2.0 datasets:
<a href="https://ibb.co/0Yhg31Q"><img src="https://i.ibb.co/F8gStcn/Model-card-peft-lora.webp" alt="Model-card-peft-lora" align="center"></a>
LoRA BF16,
batch_size=2,
steps=10000, gradient_accumulation_steps = 4,
warmup_steps = 5,
max_steps = 10000
learning_rate = 2e-4,
fp16 = not is_bfloat16_supported(),
bf16 = is_bfloat16_supported(),
logging_steps = 1,
optim = "adamw_8bit",
weight_decay = 0.01,
lr_scheduler_type = "linear",
seed = 3407
[Open-Orca/SlimOrca]
MMLU Pro 0-shot: 0.2937
[TIGER-AI-Lab/MMLU-Pro]
Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).