Downloads · 30 days
9
15% of all-time downloads
ontocord/1.7b-MixtureVitae-300BT-v1-decontaminated-sft-mv_qwen-magpie
1.7b-MixtureVitae-300BT-v1-decontaminated-sft-mv_qwen-magpie is a machine learning model from ontocord. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
SFT fine-tune of ontocord/1.7b-MixtureVitae-300BT-v1-decontaminated on ontocord/MVQwen-Magpie.
Downloads · 30 days
9
15% of all-time downloads
All-time downloads
59
Public
Parameters
1.8B
3.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.6 GB · 100%
From the Hugging Face model README
SFT fine-tune of ontocord/1.7b-MixtureVitae-300BT-v1-decontaminated on ontocord/MV_Qwen-Magpie.
| Parameter | Value |
|---|---|
| Base model | ontocord/1.7b-MixtureVitae-300BT-v1-decontaminated |
| Dataset | ontocord/MV_Qwen-Magpie (1048 examples) |
| Method | SFT |
| Epochs | 2 |
| Learning rate | 5e-6 |
| LR scheduler | linear |
| Warmup ratio | 0.03 |
| Effective batch size | 128 |
| Per-device batch size | 16 |
| Max sequence length | 4096 |
| Precision | bf16 |
| Gradient checkpointing | true |
| Chat template | tulu3 |
| Packing | false |
| DeepSpeed | ZeRO Stage 2 |
| Optimizer | AdamW (beta1=0.9, beta2=0.999, eps=1e-8) |
| Weight decay | 0.0 |
| Seed | 42 |
| Nodes | 2 x 4 GPUs (H100) |