Downloads · 30 days
0
MiniGPT-30M-Wikipedia
RinKana/MiniGPT-30M-Wikipedia
MiniGPT-30M-Wikipedia is a text generation model from RinKana. Use it when you need the model to write or continue text. It is set up for pytorch. The card lists the license as apache-2.0.
A Small Language Model (SLM) ~30M parameters built from scratch. This model was trained as part of an architectural study of pre-LLM structures.
Access
Public
Updated Feb 4, 2026
Parameters
49.4M
318 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors198 MB · 99%
At a glance
- Task
- Text Generation
- Library
- pytorch
- License
- apache-2.0
- Access
- Public
- Created
- Feb 2, 2026
- Updated
- Feb 4, 2026
- SHA
- 009e72e4
Try a prompt
Datasets
Model card
From the Hugging Face model README
MiniGPT-30M-Wikipedia
A Small Language Model (SLM) ~30M parameters built from scratch. This model was trained as part of an architectural study of pre-LLM structures.
Model Details
- Architecture: GPT-style Decoder-only Transformer
- Parameters: ~30 Million
- Layers: 6
- Attention Heads: 8
- Embedding Dimension: 384
- Context Size: 512 tokens
Training Configuration
- Dataset: WikiText-103
- Hardware: 2x NVIDIA T4 GPUs (Kaggle)
- Epochs: 1
- Task
- Text Generation
- Library
- pytorch
- License
- apache-2.0
- Languages
- en
- Created
- Feb 2, 2026
- Updated
- Feb 4, 2026