Downloads · 30 days
2.1K
55% of all-time downloads
iapp/openthai2.0-legal-thaillm-nemotron-3-nano-30b-a3b-GGUF
openthai2.0-legal-thaillm-nemotron-3-nano-30b-a3b-GGUF is a text generation model from iapp. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
<div align="center" <img src="https://huggingface.co/spaces/openthaigpt/README/resolve/main/openthai-logo-white.png" width="160" alt="OpenThai"
Downloads · 30 days
2.1K
55% of all-time downloads
All-time downloads
3.7K
Public
Repo size
84.1 GB
Likes
2
Trending 1
Click a slice to open those files.
.gguf84.1 GB · 100%
From the Hugging Face model README
Developed by iApp, launched with AIEAT. Part of OpenThai (formerly OpenThaiGPT).
Official GGUF quantizations of iapp/openthai2.0-legal-thaillm-nemotron-3-nano-30b-a3b
Website · Announcement · Live demo · Discord
</div>An open-weight Thai legal LLM that recalls Thai statutes and cites the exact law name and section (มาตรา) as structured JSON. 30B Mixture-of-Experts with only ~3B parameters active per token — which is why a 30B model runs comfortably on modest hardware.
Use it with retrieval. Open-book citation accuracy is 0.99 versus 0.07–0.40 from pure memory. Pair it with OpenThaiRAG or your own retrieval over authoritative statute text.
| File | Quant | Size | Notes |
|---|---|---|---|
openthai2.0-legal-thaillm-nemotron-3-nano-30b-a3b.Q4_K_M.gguf | Q4_K_M | ~18 GB | Recommended. Fits a 24 GB GPU. |
openthai2.0-legal-thaillm-nemotron-3-nano-30b-a3b.Q5_K_M.gguf | Q5_K_M | ~21 GB | Higher quality. |
openthai2.0-legal-thaillm-nemotron-3-nano-30b-a3b.Q8_0.gguf | Q8_0 | ~32 GB | Near-lossless. |
Ollama
ollama run hf.co/iapp/openthai2.0-legal-thaillm-nemotron-3-nano-30b-a3b-GGUF:Q4_K_M
llama.cpp
llama-cli -m openthai2.0-legal-thaillm-nemotron-3-nano-30b-a3b.Q4_K_M.gguf \
-p "ลักทรัพย์ในเวลากลางคืน ผิดมาตราใด" -n 1024 --temp 0.3
The chat template is embedded in the GGUF. Recommended sampling: temperature=0.3,
top_p=0.9. Architecture is a hybrid Mamba2-Transformer MoE (NVIDIA
Nemotron-3-Nano-30B-A3B base) — use a recent llama.cpp build.
Outputs are decision support, not legal advice. Verify every citation against the current statute text. Near-miss rejection — telling the governing section from a closely related one — is the hardest task for every model tested, this one included.
@misc{openthai2026legal,
title = {OpenThai 2.0 Legal: An Open-Weight Thai Legal Language Model},
author = {Viriyayudhakorn, Kobkrit and Yuenyong, Sumeth and Chay-intr, Thodsaporn},
year = {2026},
url = {https://openthai.aieat.or.th/openthai2p0-legal}
}
OpenThai (formerly OpenThaiGPT) — free, open-weight Thai large language models. Developed by iApp, launched with AIEAT. This model is built on the NVIDIA Nemotron and NeMo stack. With thanks to the community members who published unofficial GGUF conversions before these existed.