Downloads · 30 days
66
11% of all-time downloads
typhoon2.5-qwen3-30b-a3b-GGUF
terasut/typhoon2.5-qwen3-30b-a3b-GGUF
typhoon2.5-qwen3-30b-a3b-GGUF is a machine learning model from terasut. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF-format conversions of the scb10x/typhoon2.5-qwen3-30b-a3b model for efficient inference with llama.cpp and compatible runtimes.
All-time downloads
577
Public
Repo size
173 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf173 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Oct 20, 2025
- Updated
- Oct 20, 2025
- SHA
- 67fd3913
Model card
From the Hugging Face model README
Typhoon2.5-Qwen3-30B-A3B (GGUF)
GGUF-format conversions of the scb10x/typhoon2.5-qwen3-30b-a3b model for efficient inference with llama.cpp and compatible runtimes.
Converted using llama.cpp’s convert_hf_to_gguf.py and quantize tool. No additional training or fine-tuning was performed.
🧩 Variants
| Variant | File size |
|---|---|
| BF16 | 61.1 GB |
| F16 | 61.1 GB |
| Q8_0 | 32.5 GB |
| Q_K_M | 18.6 GB |
📝 Notes
- Source model: scb10x/typhoon2.5-qwen3-30b-a3b
- Tokenizer and metadata preserved during conversion
- Choose BF16 for best fidelity, F16 for GPU does not support BF16, Q8_0 for balance, Q4_K_M for lowest memory
⚖️ License
Weights inherit the upstream model’s license.
This repository redistributes format-converted copies only.
Please review and comply with the upstream terms before use.
📝 Acknowledgments
Original model by SCB10X.
GGUF conversion with quantization performed via llama.cpp tooling.
- License
- apache-2.0
- Created
- Oct 20, 2025
- Updated
- Oct 20, 2025