Downloads · 30 days
21
23% of all-time downloads
Monad
Yuvrajxms09/Monad
Monad is a text generation model from Yuvrajxms09. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
The model has been trained on the WinoGrande dataset which tests the ability to resolve pronouns and make logical inferences in everyday scenarios.
All-time downloads
91
Public
Parameters
56.7M
227 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors227 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jan 10, 2026
- Updated
- Jan 10, 2026
- SHA
- 5b559bdc
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Model Details
Model Description
The model has been trained on the WinoGrande dataset which tests the ability to resolve pronouns and make logical inferences in everyday scenarios.
Model Sources
- Base Model: https://huggingface.co/PleIAs/Monad
Training Data
Dataset: WinoGrande (allenai/winogrande)
- Size: 9,248 training examples, 1,267 validation examples
- Task: Commonsense reasoning with pronoun resolution
- Format: Multiple choice questions requiring logical reasoning
Training Hyperparameters
| Epochs | Batch Size | Learning Rate | Warmup Ratio | Warmup Steps | Weight Decay | Max Gradient Norm | Evaluation Steps | Save Steps | Early Stopping Patience |
|---|---|---|---|---|---|---|---|---|---|
| 5 | 16 | 1e-05 | 0.05 | 144 | 0.01 | 1.0 | 150 | 150 | 7 |
Training Results
| Metric | Value |
|---|---|
| Final Training Loss | 0.9143 |
| Training Time | 1,526.9s |
Validation Performance
Validation loss stabilized between 0.83-0.86 throughout the training
Summary
The model achieved strong convergence during training:
- Final training loss: 0.9143
- Evaluation loss: ~0.834 (final checkpoint)
- Training completed: All 5 epochs with early stopping monitoring
Compute Infrastructure
Hardware
- GPU: Single NVIDIA A10G (24GB VRAM)
- Platform: Modal.com
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Jan 10, 2026
- Updated
- Jan 10, 2026