Downloads · 30 days
0
tinygroot-sft-mtp-heads-20260527-2
harshbhatt7585/tinygroot-sft-mtp-heads-20260527-2
tinygroot-sft-mtp-heads-20260527-2 is a machine learning model from harshbhatt7585. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for pytorch.
tinyGroot checkpoint uploaded from the training pipeline.
Access
Public
Updated Jun 5, 2026
Repo size
676 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt676 MB · 100%
At a glance
- Library
- pytorch
- Access
- Public
- Created
- Jun 5, 2026
- Updated
- Jun 5, 2026
- SHA
- ec7c2d65
Model card
From the Hugging Face model README
harshbhatt7585/tinygroot-sft-mtp-heads-20260527-2
tinyGroot checkpoint uploaded from the training pipeline.
Checkpoint
- Step:
974 - Tokenizer:
nanochat - Layers:
12 - Hidden size:
768 - Heads:
6 - MTP heads:
2 - Max sequence length:
2048 - Source run:
sft-mtp-heads-20260527-2
Files
model.pt: model state_dict (mmap+weights_only=Truefriendly).optimizer.pt: optimizer and grad-scaler state (only needed to resume training).meta.json: step, model config, tokenizer type, and original training args.tokenizer_hf/tokenizer.json: tokenizer used by this checkpoint.
Load this checkpoint with the tinyGroot codebase, not the Transformers AutoModel API.
- Library
- pytorch
- Created
- Jun 5, 2026
- Updated
- Jun 5, 2026