Downloads · 30 days
1.5K
79% of all-time downloads
Thox-ai/ThoxNano-135M
ThoxNano-135M is a text generation model from Thox-ai. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
Downloads · 30 days
1.5K
79% of all-time downloads
All-time downloads
1.9K
Public
Parameters
135M
1.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors269 MB · 71%
From the Hugging Face model README
ThoxKey Tier Model — the smallest THOX device model, built for the ThoxKey tier: a LoRA fine-tune (rank 32) on a THOX-authored corpus of 982 chat, tool-use, and factuality examples, merged into the base weights
GATE49 23/49 (development set) · Safetensors weights · GGUF: Q4_K_M · Live on Ollama
</div>Run it: Ollama — Thox-ai/thoxnano-135m · Find your model: THOX Model Factory · Collection: Flagship & Edge Device Models
<div align="center"> <a href="https://www.kickstarter.com/projects/thox/four-devices-one-private-ai-ecosystem-thoxai?ref=4tzhm0"><img src="https://huggingface.co/spaces/Thox-ai/README/resolve/main/back-thox-on-kickstarter.jpg" alt="Back THOX on Kickstarter" width="520"></a> </div>Your AI. Your Data. Your Rules.™
Status: PUBLISHED — GROUNDING REQUIRED. Deployed surfaces supply facts through the serving layer; the bare weights are not a reliable source of THOX facts. The full gate result is printed under Evaluation.
ThoxNano-135M is the smallest THOX device model, built for the ThoxKey tier: a LoRA fine-tune (rank 32) on a THOX-authored corpus of 982 chat, tool-use, and factuality examples, merged into the base weights. Status: PUBLISHED, grounding required. The Key tier is mesh-served: a connected host computer does the compute, and facts are supplied by the serving layer.
chat_template.jinja, shipped in this repo).| Base model | HuggingFaceTB/SmolLM-135M |
| Parameters | 135M |
| Formats | Safetensors weights · GGUF: Q4_K_M · Ollama Modelfile |
| Training | LoRA fine-tune (rank 32) on a THOX-authored corpus of 982 chat, tool-use, and factuality examples, merged into the base weights |
| License | Apache-2.0. The THOX fine-tune and additions in this repo are covered under Apache-2.0; see the license text for terms. |
| This repository contains | Full weights and tokenizer in this repo |
| File | Size | Purpose |
|---|---|---|
model.safetensors | 269,060,552 B | Model weights (safetensors) |
ThoxNano-135M.Q4_K_M.gguf | 105,453,888 B | GGUF model build |
tokenizer.json | 3,522,871 B | Tokenizer files |
.gitattributes | 1,581 B | Repository file |
tokenizer_config.json | 802 B | Tokenizer files |
Modelfile | 795 B | Ollama model definition |
config.json | 721 B | Model configuration |
training_summary.json | 417 B | JSON metadata |
chat_template.jinja | 196 B | Chat template |
generation_config.json | 132 B | Generation configuration |
This repo carries the merged weights (safetensors), a Q4_K_M GGUF, an Ollama Modelfile, and the chat template (chat_template.jinja, shipped in this repo).
ollama pull Thox-ai/thoxnano-135m
ollama run Thox-ai/thoxnano-135m
hf download Thox-ai/ThoxNano-135M ThoxNano-135M.Q4_K_M.gguf --local-dir ./ThoxNano-135M
| Platform / device | Run path |
|---|---|
| Ollama (laptop / desktop) | ollama run Thox-ai/thoxnano-135m |
| Hugging Face | Download the builds listed under Files from this repo (see Run it) |
THOX fine-tune of HuggingFaceTB/SmolLM-135M. The corpus and procedure are described in this card as published at release (see Summary and Evaluation); no training beyond what this card describes is claimed for this repository.
Measured with the THOX GATE49 factuality gate (49 questions, weights only, no serving-side grounding; GATE49 is a development set, abstention-weighted). Full narrative under Evaluation below.
| Benchmark | Result |
|---|---|
| Total | 23/49 — mean 3.0/5 |
| Hard failures | 10 |
THOX GATE49 factuality gate (49 questions, weights only, no serving-side grounding), most recent evaluation of the shipped build: 23/49 passed, mean 3.0/5, 10 hard failures. This is a weak gate result, the expected posture at this size; the model is published for identity, voice, and routing behaviour under grounding, not for factual recall from the weights.
Published by THOX.ai as Thox-ai/ThoxNano-135M. Upstream base: HuggingFaceTB/SmolLM-135M. This card was conformed to THOX Model Card Standard v1.0 on 2026-10-31 (frontmatter, tags, header, files, and section structure); the technical content is as published at release.
Apache-2.0. The THOX fine-tune and additions in this repo are covered under Apache-2.0; see the license text for terms.
THOX.ai — Your AI. Your Data. Your Rules.™
@misc{thoxai2026thoxnano135m,
title={ThoxNano-135M},
author={THOX.ai},
year={2026},
url={https://huggingface.co/Thox-ai/ThoxNano-135M}
}