Downloads · 30 days
82
8% of all-time downloads
sthaps/openthaigpt-thaillm-8b-instruct-v0.7.2-research-preview-gguf
openthaigpt-thaillm-8b-instruct-v0.7.2-research-preview-gguf is a machine learning model from sthaps. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
This repository contains GGUF weights for openthaigpt/openthaigpt-thaillm-8b-instruct-v0.7.2-research-preview.
Downloads · 30 days
82
8% of all-time downloads
All-time downloads
1.1K
Public
Repo size
17.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf17.2 GB · 100%
From the Hugging Face model README
This repository contains GGUF weights for openthaigpt/openthaigpt-thaillm-8b-instruct-v0.7.2-research-preview.
For a convenient overview and download list, visit our model page.
If you are unsure how to use GGUF files, refer to the llama.cpp documentation for more details.
./llama-cli -m openthaigpt-thaillm-8b-instruct-v0.7.2-research-preview-q4_k_m.gguf -p "Hello!"
(sorted by size, not necessarily quality)
| Link | Type | Size/GB | Notes |
|---|---|---|---|
| GGUF | q2_k | 3.06 | very low quality, for testing |
| GGUF | q3_k_m | 3.84 | |
| GGUF | q4_0 | 4.45 | |
| GGUF | q4_k_m | 4.68 | recommended, good balance |
Special thanks to the llama.cpp team for their amazing work.