Downloads · 30 days
0
banalata
barunsaha/banalata
banalata is a machine learning model from barunsaha. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Decoder-only transformer trained from scratch on public-domain Bengali literary text (banglasahitya dataset).
Access
Public
Updated Apr 18, 2026
Repo size
1.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt334 MB · 72%
At a glance
- Access
- Public
- Created
- Apr 12, 2026
- Updated
- Apr 18, 2026
- SHA
- f926b845
Model card
From the Hugging Face model README
Banalata — banalata_2026-04-12_iter6900_val3.7835
Decoder-only transformer trained from scratch on public-domain Bengali literary text (bangla_sahitya dataset).
Model details
- Architecture : GPT (decoder-only), RoPE + RMSNorm + SwiGLU
- Layers/Embd/Heads : 8 / 512 / 8
- Tokenizer : SentencePiece BPE, vocab=5000, trained on Bengali only
- Training : iter=6900, best val loss=3.7835
Inference
python s05_generate.py --author "রবীন্দ্রনাথ ঠাকুর"
python s05_generate.py --prompt "আকাশ ভরা সূর্য তারা"
License
Trained on public-domain Bengali literature. Model weights: Apache 2.0.
- Created
- Apr 12, 2026
- Updated
- Apr 18, 2026