Downloads · 30 days
0
loggenix-moe-0.4b-cactus
kshitijthakkar/loggenix-moe-0.4b-cactus
loggenix-moe-0.4b-cactus is a machine learning model from kshitijthakkar. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for cactus. The card lists the license as apache-2.0.
Pre-converted weights for Loggenix/loggenix-moe-0.4b-0.2a-sft-s3.1 in Cactus format for on-device inference.
Access
Public
Updated Feb 23, 2026
Repo size
791 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.weights780 MB · 98%
At a glance
- Library
- cactus
- License
- apache-2.0
- Access
- Public
- Created
- Feb 23, 2026
- Updated
- Feb 23, 2026
- SHA
- 209c78c2
Base models
Model card
From the Hugging Face model README
Loggenix MoE 0.4B — Cactus Format
Pre-converted weights for Loggenix/loggenix-moe-0.4b-0.2a-sft-s3.1 in Cactus format for on-device inference.
Model Details
| Property | Value |
|---|---|
| Architecture | Qwen3MoeForCausalLM |
| Parameters | ~0.4B (active ~0.2B per token) |
| Experts | 16 experts, top-2 routing |
| Hidden Dim | 512 |
| Layers | 12 |
| Attention Heads | 8 (2 KV heads) |
| Expert FFN Dim | 768 |
| Context Length | 262,144 tokens |
| Precision | FP16 |
| Vocab Size | 151,936 |
Format
These weights are in Cactus binary format (.weights files + config.txt), converted from HuggingFace safetensors using the Cactus Python conversion pipeline.
This is not a standard HuggingFace Transformers model. It is designed to be loaded directly by the Cactus C++ inference engine for mobile and edge deployment (iOS, Android, macOS, Linux ARM64).
Usage
Download the entire repo and point Cactus to the directory:
# Clone weights
git clone https://huggingface.co/kshitijthakkar/loggenix-moe-0.4b-cactus
# Use with Cactus engine
cactus run ./loggenix-moe-0.4b-cactus
Conversion
Converted using the Cactus Python converter from the original safetensors:
cactus convert Loggenix/loggenix-moe-0.4b-0.2a-sft-s3.1 ./output --precision FP16
Performance (Pixel 7a, Tensor G2)
- Decode: 36-42 tokens/sec
- TTFT: 77-248ms
- Model init: ~352ms
License
See the original model card for license details.
- Library
- cactus
- License
- apache-2.0
- Created
- Feb 23, 2026
- Updated
- Feb 23, 2026