Downloads · 30 days
960
14% of all-time downloads
openthai2.0-qwen3.8-27b-GGUF
iapp/openthai2.0-qwen3.8-27b-GGUF
openthai2.0-qwen3.8-27b-GGUF is a machine learning model from iapp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF quantizations of openthai2.0-qwen3.8-27b (v9) for llama.cpp. Includes the MTP head (exported as nextn layers) and the vision projector.
All-time downloads
6.7K
Public
Repo size
287 GB
Likes
5
Public
Repo makeup
Click a slice to open those files.
.gguf68.1 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Aug 25, 2026
- Updated
- Sep 1, 2026
- SHA
- 9c79231f
Base models
Model card
From the Hugging Face model README
OpenThai2.0 - Opensource Thai Knowledge, Document, and Agentic AI (GGUF)
GGUF quantizations of openthai2.0-qwen3.8-27b (v9) for llama.cpp. Includes the MTP head (exported as nextn layers) and the vision projector.
| file | size | use |
|---|---|---|
| openthai2.0-qwen3.8-27b-Q4_K_M.gguf | ~17 GB | recommended balance |
| openthai2.0-qwen3.8-27b-IQ2_M.gguf | ~9.8 GB | recommended 2-bit — imatrix-calibrated (Thai+EN); passes factual sanity checks that plain Q2_K fails |
| openthai2.0-qwen3.8-27b-Q2_K.gguf | ~11 GB | plain 2-bit — ⚠️ factual slips observed; prefer IQ2_M |
| openthai2.0-qwen3.8-27b-Q8_0.gguf | ~29 GB | near-lossless |
| mmproj-openthai2.0-qwen3.8-27b-F16.gguf | — | vision projector (documents/images) |
Run
llama-server -m openthai2.0-qwen3.8-27b-Q4_K_M.gguf --mmproj mmproj-openthai2.0-qwen3.8-27b-F16.gguf -c 32768
⚠️ The model reasons before it answers. Use a large context (32k) and leave max_tokens unset or >= 8192, or replies may come back empty.
Sanity-verified: Q4_K_M (CPU) and IQ2_M (GPU) answer Thai factual prompts correctly; imatrix-a80.dat is included for community re-quants. Full benchmarks and model card: see the main bf16 repo.
- License
- apache-2.0
- Languages
- th, en
- Created
- Aug 25, 2026
- Updated
- Sep 1, 2026