Downloads · 30 days
9
26% of all-time downloads
AWA-Mini-Llama-From-Scratch
tampakwilll/AWA-Mini-Llama-From-Scratch
AWA-Mini-Llama-From-Scratch is a text generation model from tampakwilll. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Pure standard autoregressive language model trained from scratch without architecture efficiency tricks.
All-time downloads
34
Public
Repo size
31.5 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin15.8 MB · 49%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- standard_vanilla_transformer
- Access
- Public
- Created
- Jun 19, 2026
- Updated
- Jun 19, 2026
- SHA
- 2e057781
Model card
From the Hugging Face model README
Standard Vanilla Transformer Model
Pure standard autoregressive language model trained from scratch without architecture efficiency tricks.
Model Configuration
- Layers: 8
- Embedding Dim: 128
- Attention Heads: 1
- Context Length: 2048
- Max Tokens per Sample: 512
- Task
- Text Generation
- Type
- standard_vanilla_transformer
- License
- apache-2.0
- Languages
- id
- Created
- Jun 19, 2026
- Updated
- Jun 19, 2026