Downloads · 30 days
76
33% of all-time downloads
ThoxMicro-1bit-16M
Thox-ai/ThoxMicro-1bit-16M
ThoxMicro-1bit-16M is a text generation model from Thox-ai. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
All-time downloads
231
Public
Repo size
25.1 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf25.1 MB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- other
- Access
- Public
- Created
- Aug 5, 2026
- Updated
- Aug 11, 2026
- SHA
- d9db0723
Try a prompt
Model card
From the Hugging Face model README
ThoxMicro-1bit-16M
Your AI. Your Data. Your Rules.
From-scratch BitNet b1.58 ternary Llama (16M) trained on TinyStories — deeper sibling of the 9M edge research model.
What this is
- Trained from scratch — no upstream base model.
- 86.6% of weights are ternary (BitNet b1.58).
- Same pending-review TinyStories licensing caveat as the 9M.
- Neither the 9M nor 16M supersedes the other.
Architecture (from config)
| Field | Value |
|---|---|
| Architecture | BitNet b1.58 ternary Llama decoder |
| Layers | 16 |
| Hidden size | 256 |
| Attention heads | 8 |
| KV heads | 8 |
| FFN / intermediate | 768 |
| Vocab | 8,192 (own byte-level BPE) |
| Max context | 512 |
| Tied embeddings | yes |
Intended use
On-device / edge text generation within the THOX stack. Not a safety-aligned public assistant unless deployed behind THOX guardrails.
Usage
llama.cpp
huggingface-cli download Thox-ai/ThoxMicro-1bit-16M --include '*.gguf' --local-dir ./ThoxMicro-1bit-16M
llama-cli -m ./ThoxMicro-1bit-16M/model-TQ2_0.gguf -p "Hello"
Links
- Ollama:
ollama.com/thox-ai/<slug>— verify with the Ollama lane (task 80017303) - Docs: https://docs.thox.ai
THOX.ai LLC — Your AI. Your Data. Your Rules. · On-device and private by design.
- Task
- Text Generation
- Library
- gguf
- License
- other
- Languages
- en
- Created
- Aug 5, 2026
- Updated
- Aug 11, 2026