Downloads · 30 days
13
3% of all-time downloads
Nexus1-124M-v1
mnnobi/Nexus1-124M-v1
Nexus1-124M-v1 is a text generation model from mnnobi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Nexus1 is the first prototype in the Nexus LLM series. It is a 124M parameter decoder-only transformer pre-trained from scratch on high-quality educational web data.
All-time downloads
494
Public
Parameters
124M
19.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt996 MB · 50%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- gpt2
- Access
- Public
- Created
- Mar 8, 2026
- Updated
- Mar 9, 2026
- SHA
- 52028076
Try a prompt
Datasets
Model card
From the Hugging Face model README
Nexus1-124M-v1
Nexus1 is the first prototype in the Nexus LLM series. It is a 124M parameter decoder-only transformer pre-trained from scratch on high-quality educational web data.
Model Details
- Architecture: GPT-2 style
- Parameters: 124 Million
- Context Window: 1024 tokens
- Vocabulary Size: 50,257 (Custom BPE)
- Training Stage: Base Pre-training (Complete)
Training Data
Pre-trained on the FineWeb-Edu (10B Sample) dataset, which focuses on high-quality, educational content from the web to ensure better reasoning capabilities in a small model.
Purpose
Nexus1 serves as the proof-of-concept for the Nexus Training Pipeline. It is intended to be used as a reference model for knowledge distillation into the larger Nexus2-1B model.
How to use
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("mnnobi/Nexus1-124M-v1")
tokenizer = AutoTokenizer.from_pretrained("mnnobi/Nexus1-124M-v1")
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- apache-2.0
- Languages
- en
- Created
- Mar 8, 2026
- Updated
- Mar 9, 2026