Downloads · 30 days
168
15% of all-time downloads
Millie-35B-A3B-11GB
llmsforall/Millie-35B-A3B-11GB
Millie-35B-A3B-11GB is a text generation model from llmsforall. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Millie is a 35B-parameter mixture-of-experts coding and agentic model (3B active per token, 262K context, image input) compressed to run on ordinary hardware. It is derived from Agents-A1, built on the Qwen3.5-35B-A3B…
All-time downloads
1.1K
Public
Repo size
31.6 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf10.9 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Aug 30, 2026
- Updated
- Sep 3, 2026
- SHA
- d2e07842
Try a prompt
Model card
From the Hugging Face model README
Millie 35B-A3B 11GB
Millie is a 35B-parameter mixture-of-experts coding and agentic model (3B active per token, 262K context, image input) compressed to run on ordinary hardware. It is derived from Agents-A1, built on the Qwen3.5-35B-A3B architecture; expert weights are stored at ~2.2 bits per weight. A smaller 7 GB variant is also available.
Files
| File | Size | Contents |
|---|---|---|
| Millie-35B-A3B-11GB.gguf | 10.3 GB | language model |
| Millie-35B-A3B-mmproj.gguf | 0.6 GB | vision tower (image input) |
Running it
The GGUF files require the llmsforall llama.cpp fork, which carries the kernels for their weight format (Metal, Vulkan, CPU); upstream llama.cpp cannot load them:
llama-server -m Millie-35B-A3B-11GB.gguf --mmproj Millie-35B-A3B-mmproj.gguf
License
Apache 2.0 — see LICENSE and NOTICE.
- Task
- Text Generation
- License
- apache-2.0
- Created
- Aug 30, 2026
- Updated
- Sep 3, 2026