Downloads · 30 days
3
27% of all-time downloads
baseline
muskuskus/baseline
baseline is a machine learning model from muskuskus. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
A dense language model trained on filtered C4 (step 100000).
All-time downloads
11
Public
Parameters
39.9M
311 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors159 MB · 100%
At a glance
- Access
- Public
- Created
- Jun 19, 2026
- Updated
- Jun 19, 2026
- SHA
- 5b4b90de
Model card
From the Hugging Face model README
adaptive-moeut
A dense language model trained on filtered C4 (step 100000).
Custom architecture — not a transformers class. To load:
import torch
from safetensors.torch import load_file
from models.dense_transformer import DenseTransformer
model = DenseTransformer()
model.load_state_dict(load_file('model.safetensors'), strict=False)
(strict=False because the tied lm_head weight is deduped on upload.)
Tokenizer: SentencePiece BPE, 8k vocab (c4_bpe8k.model).
- Created
- Jun 19, 2026
- Updated
- Jun 19, 2026