Downloads · 30 days
5
7% of all-time downloads
clrs_llama_3_8b_100k_finetune_with_traces
smcleish/clrs_llama_3_8b_100k_finetune_with_traces
clrs_llama_3_8b_100k_finetune_with_traces is a text generation model from smcleish. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
meta-llama/Meta-Llama-3-8B model finetuned on 100,000 CLRS-Text examples.
All-time downloads
71
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Oct 9, 2024
- Updated
- Dec 20, 2024
- SHA
- 70c0c5a8
Try a prompt
Base models
Model card
From the Hugging Face model README
Model Details
meta-llama/Meta-Llama-3-8B model finetuned on 100,000 CLRS-Text examples.
Training Details
- Learning Rate: 1e-4, 150 warmup steps then cosine decayed to 5e-06 using AdamW optimiser
- Batch size: 128
- Loss taken over answer only, not on question.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Created
- Oct 9, 2024
- Updated
- Dec 20, 2024