Downloads · 30 days
5
8% of all-time downloads
nanochat-d18-pretrain
destinefut/nanochat-d18-pretrain
nanochat-d18-pretrain is a machine learning model from destinefut. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for generic. The card lists the license as mit.
The model configuration (derived from meta002849.json) is as follows:
All-time downloads
62
Public
Repo size
3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt3 GB · 100%
At a glance
- Library
- generic
- License
- mit
- Model type
- nanochat
- Access
- Public
- Created
- Mar 6, 2026
- Updated
- Mar 7, 2026
- SHA
- 27495a0b
Model card
From the Hugging Face model README
Model Specs
The model configuration (derived from meta_002849.json) is as follows:
| Parameter | Value |
|---|---|
| Layers | 18 |
| Embedding Dim | 1152 |
| Heads (Q/KV) | 9 / 9 (GQA) |
| Vocab Size | 65,536 |
| Max Seq Len | 2048 |
| Window Pattern | SSSL |
Quick Start
This model uses a custom architecture and cannot be loaded directly via the standard transformers library. Please use the source code from the official GitHub repository.
git clone https://github.com/DestineG/nanochat.git
cd nanochat
git checkout v1.0
- Library
- generic
- Type
- nanochat
- License
- mit
- Created
- Mar 6, 2026
- Updated
- Mar 7, 2026