Downloads · 30 days
0
qwen-amharic
amanuelbyte/qwen-amharic
qwen-amharic is a machine learning model from amanuelbyte. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Private Amharic GPT-style model checkpoint.
Access
Public
Updated Aug 20, 2025
Repo size
132 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin131 MB · 95%
At a glance
- Access
- Public
- Created
- Aug 20, 2025
- Updated
- Aug 20, 2025
- SHA
- 7ffa78b2
Model card
From the Hugging Face model README
qwen-amharic
Private Amharic GPT-style model checkpoint.
Environment
- Device: CUDA
- GPU: Tesla P100-PCIE-16GB
- Memory: 17.1 GB
- 🌱 Set all seeds to 42
Model Configuration
- Architecture: 384d, 6L, 8H, 1536ff
- Training: 20000 steps, batch size 24
- Data: 500,000 tokens, seq_len 512
Data Processing
- 🔄 Processing new data (will cache for future use)
- Loaded 2000 documents (skipped 0 empty/None)
- Tokenizing texts...
- Using 154,226 tokens
- 💾 Cached data to data_cache/tokenized_data_2000_500000.pkl
- 📊 Dataset: 138343 train, 15371 val samples
Training
- 🚀 Training Small model with Muon optimizer
- 🌱 Set all seeds to 42
- 📊 Total parameters: 32,863,680
- Muon parameters: 13,271,040
- AdamW parameters: 19,592,640
- Created
- Aug 20, 2025
- Updated
- Aug 20, 2025