Downloads · 30 days
0
CMBAWIKI
Viharikvs/CMBAWIKI
CMBAWIKI is a machine learning model from Viharikvs. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository contains weights for an experimental trained on the WikiText-103 dataset.
Access
Public
Updated Oct 9, 2025
Repo size
52.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt2.8 GB · 67%
At a glance
- Access
- Public
- Created
- Oct 9, 2025
- Updated
- Oct 9, 2025
- SHA
- 3666a5ed
Base models
Model card
From the Hugging Face model README
HRM-Text1 (WikiText-103)
This repository contains weights for an experimental trained on the WikiText-103 dataset.
Model Description
- Architecture: CMBA
- Training Data: wikitext/wikitext-103-raw-v1
- Tokenizer:
t5-small(slow T5 SentencePiece) - Vocab Size: 32100
- Objective: Causal Language Modeling
Latest Performance (Epoch 0)
- Validation Loss:
29.7877 - Validation Perplexity:
8642211872768.00
- Created
- Oct 9, 2025
- Updated
- Oct 9, 2025