Downloads · 30 days
6
16% of all-time downloads
AWA-Mini-Llama-From-Scratch-V3
tampakwilll/AWA-Mini-Llama-From-Scratch-V3
AWA-Mini-Llama-From-Scratch-V3 is a text generation model from tampakwilll. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Pure standard autoregressive language model trained from scratch without architecture efficiency tricks.
All-time downloads
37
Public
Repo size
33.6 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin16.8 MB · 49%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- standard_vanilla_transformer
- Access
- Public
- Created
- Jun 19, 2026
- Updated
- Jun 19, 2026
- SHA
- 23d2a4c2
Model card
From the Hugging Face model README
Standard Vanilla Transformer Model
Pure standard autoregressive language model trained from scratch without architecture efficiency tricks.
Model Configuration
- Layers: 8
- Embedding Dim: 128
- Attention Heads: 1
- Context Length: 4096
- Max Tokens per Sample: 4096
- Task
- Text Generation
- Type
- standard_vanilla_transformer
- License
- apache-2.0
- Languages
- id
- Created
- Jun 19, 2026
- Updated
- Jun 19, 2026