Downloads · 30 days
24
48% of all-time downloads
llama3.2-1B-finetuned-on-mlabonne
DamiFass/llama3.2-1B-finetuned-on-mlabonne
llama3.2-1B-finetuned-on-mlabonne is a machine learning model from DamiFass. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is the meta-llama/Llama-3.2-1B base model fine tuned on the mlabonne/orpo-dpo-mix-40k dataset.
All-time downloads
50
Public
Parameters
1.2B
4.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.9 GB · 100%
At a glance
- Model type
- llama
- Access
- Public
- Created
- Nov 11, 2024
- Updated
- Nov 11, 2024
- SHA
- a7ce2f3b
Base models
Model card
From the Hugging Face model README
Model Description
This is the meta-llama/Llama-3.2-1B base model fine tuned on the mlabonne/orpo-dpo-mix-40k dataset.
Evaluation Results
We used lm-evalutation-harness from EleutherAI to evaluate this fine-tuned version of meta-llama/Llama-3.2-1B on the 'Hellaswag' benchmark.
Hellaswag
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| hellaswag | 1 | none | 0 | acc | ↑ | 0.4773 | ± | 0.0050 |
| none | 0 | acc_norm | ↑ | 0.6358 | ± | 0.0048 |
- Type
- llama
- Created
- Nov 11, 2024
- Updated
- Nov 11, 2024