Downloads · 30 days
10
1% of all-time downloads
clrs_gemma_2b_100k_finetune_with_traces
smcleish/clrs_gemma_2b_100k_finetune_with_traces
clrs_gemma_2b_100k_finetune_with_traces is a text generation model from smcleish. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
google/gemma-2b model finetuned on 100,000 CLRS-Text examples.
All-time downloads
764
Public
Parameters
2.5B
5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- gemma
- Access
- Public
- Created
- Oct 9, 2024
- Updated
- Dec 20, 2024
- SHA
- 082438fd
Try a prompt
Base models
Model card
From the Hugging Face model README
Model Details
google/gemma-2b model finetuned on 100,000 CLRS-Text examples.
Training Details
- Learning Rate: 1e-4, 150 warmup steps then cosine decayed to 5e-06 using AdamW optimiser
- Batch size: 128
- Loss taken over answer only, not on question.
- Task
- Text Generation
- Library
- transformers
- Type
- gemma
- License
- mit
- Created
- Oct 9, 2024
- Updated
- Dec 20, 2024