Downloads · 30 days
40
18% of all-time downloads
nanochat-d20
dnakov/nanochat-d20
nanochat-d20 is a text generation model from dnakov. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Nanochat is a small language model from Andrej Karpathy, converted to HuggingFace format.
All-time downloads
219
Public
Parameters
561M
2.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.1 GB · 100%
Parameter types
How the weights are stored.
F32477M · 85%
Try a prompt
Model card
From the Hugging Face model README
Nanochat
Nanochat is a small language model from Andrej Karpathy, converted to HuggingFace format.
Model Details
- Architecture: GPT-style transformer with RoPE, QK normalization, ReLU², and logits softcap
- Parameters: ~393M
- Hidden Size: 1280
- Layers: 20
- Attention Heads: 10
- Vocabulary: 65536 tokens
- Context Length: 2048 tokens
Usage
With Transformers (PyTorch)
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("<model-path>", trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained("<model-path>")
prompt = "Once upon a time"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=50)
print(tokenizer.decode(outputs[0]))
Converting to MLX
To use with Apple's MLX framework:
mlx_lm.convert --hf-path <model-path> --mlx-path nanochat-mlx --trust-remote-code
mlx_lm.generate --model nanochat-mlx --prompt "Once upon a time"
Citation
Original model by Andrej Karpathy: https://github.com/karpathy/nanochat
- Task
- Text Generation
- Library
- transformers
- Type
- nanochat
- License
- mit
- Languages
- en
- Created
- Oct 15, 2025
- Updated
- Oct 15, 2025