Downloads · 30 days
45
16% of all-time downloads
realoperator42/trinity-nano-stheno-GGUF
trinity-nano-stheno-GGUF is a machine learning model from realoperator42. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
realoperator42/trinity-nano-stheno-lora (attention-only LoRA, r=16, alpha=32) merged into arcee-ai/Trinity-Nano-Preview and converted to GGUF.
Downloads · 30 days
45
16% of all-time downloads
All-time downloads
280
Public
Repo size
10.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf10.3 GB · 100%
From the Hugging Face model README
realoperator42/trinity-nano-stheno-lora (attention-only LoRA, r=16, alpha=32) merged into
arcee-ai/Trinity-Nano-Preview and converted to GGUF.
Architecture is afmoe, so you need a llama.cpp build that includes AFMOE support.
The embedded chat template is the adapter's corrected ChatML, with the training-only
{% generation %} markers removed so --jinja parses cleanly.
llama-cli -m trinity-nano-stheno-Q4_K_M.gguf --jinja -cnv
| File | Size |
|---|---|
trinity-nano-stheno-Q4_K_M.gguf | 3.8 GB |
trinity-nano-stheno-Q8_0.gguf | 6.5 GB |