Downloads · 30 days
72
15% of all-time downloads
FrontD.11m
11-47/FrontD.11m
FrontD.11m is a text generation model from 11-47. Use it when you need the model to write or continue text. It is set up for pytorch. The card lists the license as mit.
FrontD.11m is an approximately 11-million-parameter decoder-only language model trained completely from scratch.
All-time downloads
487
Public
Repo size
2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt132 MB · 45%
At a glance
- Task
- Text Generation
- Library
- pytorch
- License
- mit
- Model type
- frontd
- Access
- Public
- Created
- Aug 19, 2026
- Updated
- Aug 19, 2026
- SHA
- 368dc892
Try a prompt
Model card
From the Hugging Face model README
FrontD.11m
FrontD.11m is an approximately 11-million-parameter decoder-only language model trained completely from scratch.
Architecture
- Parameters: 10,996,608
- Context: 1096
- Vocabulary: 16000
- Hidden size: 256
- Layers: 6
- Attention heads: 16
- FFN size: 1152
- RoPE
- RMSNorm
- SwiGLU
- Tied input/output embeddings
Pretraining dataset
Plans11/Organized_PreTrain_1k_Context
Training
Training is performed in 20,000-example sessions.
A persistent SHA-256 example ledger records only examples whose training session has successfully completed.
The model is initialized randomly and pretrained from scratch.
- Task
- Text Generation
- Library
- pytorch
- Type
- frontd
- License
- mit
- Created
- Aug 19, 2026
- Updated
- Aug 19, 2026