Downloads · 30 days
19
5% of all-time downloads
Thiraput01/WangchanLION-v3-IT-GGUF
WangchanLION-v3-IT-GGUF is a text generation model from Thiraput01. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.1.
This repository contains WangchanLION-v3-IT converted to the GGUF format with llama.cpp. See the original model here: aisingapore/WangchanLION-v3-IT
Downloads · 30 days
19
5% of all-time downloads
All-time downloads
376
Public
Repo size
26.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf26.2 GB · 100%
From the Hugging Face model README
This repository contains WangchanLION-v3-IT converted to the GGUF format with llama.cpp. See the original model here: aisingapore/WangchanLION-v3-IT
Recommendation: choose the highest-quality quantisation that fits your hardware (VRAM / RAM).
Filename (→ .gguf) | Quant method | Bits | Size (GB) |
|---|---|---|---|
model-8B-f16 | None | 16 | 16.1 |
model-8B-q8 | Q8_0 | 8 | 5.25 |
model-8B-q4_k_m | Q4_K_M | 4 | 4.92 |