Downloads · 30 days
32
6% of all-time downloads
LLaMa-3.2-Instruct-JankMix-v0.2-SFT-3B
PJMixers-Dev/LLaMa-3.2-Instruct-JankMix-v0.2-SFT-3B
LLaMa-3.2-Instruct-JankMix-v0.2-SFT-3B is a machine learning model from PJMixers-Dev. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.2.
A much further trained version, this time done with full finetuning instead of DoRA. Similar ~50/50 mix of completion and instruct data.
All-time downloads
509
Public
Parameters
3.2B
6.4 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors6.4 GB · 100%
At a glance
- License
- llama3.2
- Model type
- llama
- Access
- Public
- Created
- Oct 14, 2024
- Updated
- Oct 28, 2024
- SHA
- 82afbb79
Base models
Model card
From the Hugging Face model README
A much further trained version, this time done with full finetuning instead of DoRA. Similar ~50/50 mix of completion and instruct data.
Note: This likely has refusals like PJMixers-Dev/LLaMa-3.2-Instruct-JankMix-v0.1-SFT-3B since no focus was put on removing refusals. I'm working on a KTO DoRA to solve this, and possibly improve roleplay performance.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 21.50 |
| IFEval (0-Shot) | 62.92 |
| BBH (3-Shot) | 23.34 |
| MATH Lvl 5 (4-Shot) | 11.33 |
| GPQA (0-shot) | 3.02 |
| MuSR (0-shot) | 4.87 |
| MMLU-PRO (5-shot) | 23.50 |
- Type
- llama
- License
- llama3.2
- Languages
- en
- Created
- Oct 14, 2024
- Updated
- Oct 28, 2024