Downloads · 30 days
24
5% of all-time downloads
orpheus-checkpoints-87330
aslon1213/orpheus-checkpoints-87330
orpheus-checkpoints-87330 is a text generation model from aslon1213. Use it when you need the model to write or continue text. It is set up for transformers.
- Developed by: aslon1213 - License: apache-2.0 - Finetuned from model : aslon1213/orpheus-checkpoints-87330
All-time downloads
486
Public
Parameters
3.3B
13.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors13.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Jan 1, 2026
- Updated
- Jan 7, 2026
- SHA
- c03838f6
Base models
Model card
From the Hugging Face model README
Uploaded model
- Developed by: aslon1213
- License: apache-2.0
- Finetuned from model : aslon1213/orpheus-checkpoints-87330
🧠 Base Model
- Base model: meta-llama/Llama-3.2-3B-Instruct
- Tokenizer: meta-llama/Llama-3.2-3B-Instruct
- Architecture: LLaMA
- License: Apache-2.0
🚀 Pretraining Configuration
Training Setup
- Epochs: 1
- Batch size: 1
- Learning rate: 5e-5
- Training processes: 8
- Padding token ID: 128263
- Save steps: 12,000
- Data mixing ratio: 0.05
- Total batches: 87,330
- Per Epoch Time: 8 hours on 1 GPU
Hardware
- GPU: 1× NVIDIA H100
Pretrain Datasets
- Text QA: aslon1213/orpheus_qa_dataset - 26.5K samples
- TTS: aslon1213/orpheus-tts-dataset - 500K samples
Metrics Available at this link
Acknowledgements:
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Languages
- uz
- Created
- Jan 1, 2026
- Updated
- Jan 7, 2026