ThoxMicro-1bit-9M

Thox-ai/ThoxMicro-1bit-9M

ThoxMicro-1bit-9M is a text generation model from Thox-ai. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.

Downloads · 30 days

134

64% of all-time downloads

All-time downloads

210

Public

Repo size

16 MB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf16 MB · 100%

At a glance

Task: Text Generation
Library: gguf
License: other
Access: Public
Created: Aug 5, 2026
Updated: Aug 11, 2026
SHA: 6cd19e98

Try a prompt

Spaces

Model card

From the Hugging Face model README

ThoxMicro-1bit-9M

Your AI. Your Data. Your Rules.

From-scratch BitNet b1.58 ternary Llama (9M) trained on TinyStories — a story-completion / edge research artifact, not an assistant.

What this is

Trained from scratch — no upstream base model.
76.4% of weights are ternary {-1,0,+1} (BitNet b1.58).
License is unresolved: TinyStories (CDLA-Sharing-1.0) share-alike not yet cleared — treat as pending review, not open for redistribution until THOX confirms.
Sibling: ThoxMicro-1bit-16M (deeper, not a replacement).

Architecture (from config)

Field	Value
Architecture	BitNet b1.58 ternary Llama decoder
Layers	8
Hidden size	256
Attention heads	8
KV heads	8
FFN / intermediate	768
Vocab	8,192 (own byte-level BPE)
Max context	512
Tied embeddings	yes

Intended use

On-device / edge text generation within the THOX stack. Not a safety-aligned public assistant unless deployed behind THOX guardrails.

Usage

llama.cpp

huggingface-cli download Thox-ai/ThoxMicro-1bit-9M --include '*.gguf' --local-dir ./ThoxMicro-1bit-9M
llama-cli -m ./ThoxMicro-1bit-9M/model-TQ2_0.gguf -p "Hello"

Repo makeup

At a glance

Try a prompt

Spaces

Model card

ThoxMicro-1bit-9M

What this is

Architecture (from config)

Intended use

Usage

Links