Downloads · 30 days
0
llama31-8b-sft-mask
garg-aayush/llama31-8b-sft-mask
llama31-8b-sft-mask is a machine learning model from garg-aayush. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.1.
Fine-tuned LLaMA-3.1-8B using SFT instruction tuning with prompt masking (loss computed only on response tokens).
Access
Public
Updated Dec 2, 2025
Repo size
129 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors128 GB · 100%
At a glance
- License
- llama3.1
- Access
- Public
- Created
- Nov 26, 2025
- Updated
- Dec 2, 2025
- SHA
- e883d9fb
Base models
Datasets
Model card
From the Hugging Face model README
LLaMA-3.1-8B SFT (Prompt Masking)
Fine-tuned LLaMA-3.1-8B using SFT instruction tuning with prompt masking (loss computed only on response tokens).
Training Details
- Base Model: meta-llama/Llama-3.1-8B
- Dataset: UltraChat-200K + SafetyLlama (~200K examples)
- Training: 1 epoch (6326 steps)
- Prompt Masking: Enabled (loss on response tokens only)
Evaluation Results
| Benchmark | Baseline | This Model |
|---|---|---|
| GSM8K | 16.4% | 32.7% |
| MMLU | 58.1% | 58.2% |
| SST Safety | 62.0% | 77.0% |
| AlpacaEval | 1.57% | 4.5% |
Files
eval_baseline/: Baseline evaluation results (pre-finetuning Llama-3.1-8B)
Reference
Part of CS336 Assignment 5 (SFT Instruction Tuning). See building-from-scratch/sft for details.
- License
- llama3.1
- Created
- Nov 26, 2025
- Updated
- Dec 2, 2025