Trinity-337B

0xSero/Trinity-337B

Trinity-337B is a text generation model from 0xSero. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.

[!TIP] Support this work → · X · GitHub · REAP paper · Cerebras REAP

Downloads · 30 days

18% of all-time downloads

All-time downloads

146

Public

Parameters

337B

675 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors675 GB · 100%

Parameter types

How the weights are stored.

BF16337B · 100%

Try a prompt

Model card

From the Hugging Face model README

[!TIP] Support this work → · X · GitHub · REAP paper · Cerebras REAP

Trinity-337B

REAP-pruned the base model.

At a glance


Base model	—
Format	BF16
Total params	337B
Active / token	—
Experts / layer	216
Layers	60
Hidden size	3072
Context	262,144
On-disk size	675 GB

Which variant should I pick?

Variant	Format	Link
`Trinity-337B` (this)	BF16	link
`Trinity-337B-W4A16`	W4A16	link
`Trinity-337B-W4A16-192`	W4A16	link

License & citation

License inherited from the base model.

@misc{lasby2025reap,
  title  = {REAP the Experts: Why Pruning Prevails for One-Shot MoE Compression},
  author = {Mike Lasby and Ivan Lazarevich and Nish Sinnadurai and Sean Lie and Yani Ioannou and Vithursan Thangarasa},
  year   = {2025}, eprint = {2510.13999}, archivePrefix = {arXiv}
}

Repo makeup

Parameter types

Try a prompt

Model card

Trinity-337B

At a glance

Which variant should I pick?

License & citation

Sponsors