Downloads · 30 days
12
5% of all-time downloads
distil-gemma-2-2b
macadeliccc/distil-gemma-2-2b
distil-gemma-2-2b is a machine learning model from macadeliccc. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model is a gemma 2 2b model distilled from google/gemma-2-9b-it and finetuned on the tome.
All-time downloads
219
Public
Parameters
3.2B
43 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pt36.6 GB · 74%
At a glance
- Model type
- gemma2
- Access
- Public
- Created
- Aug 2, 2024
- Updated
- Aug 2, 2024
- SHA
- 2b025aed
Base models
Datasets
Model card
From the Hugging Face model README
Distil Gemma 2 2b
This model is a gemma 2 2b model distilled from google/gemma-2-9b-it and finetuned on the tome.
Prompt Template
ChatML
<|im_start|>system
{system}<|im_end|>
<|im_start|>user
{user}<|im_end|>
<|im_start|>assistant
Training Information
This model trained on 8x Nvidia H100 NVL for the equivalent of 120 GPU hours.
- Loss Achieved: 0.27
- Epochs: 3
Checkpoints are available in the repo to continue training
Evals
IN PROGRESS
- Type
- gemma2
- Created
- Aug 2, 2024
- Updated
- Aug 2, 2024