Downloads · 30 days
199
15% of all-time downloads
rinrin0413/Qwen3-Swallow-8B-RL-v0.2-Q4_K_M-GGUF
Qwen3-Swallow-8B-RL-v0.2-Q4_K_M-GGUF is a text generation model from rinrin0413. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This is a static Q4KM quantized GGUF version of tokyotech-llm/Qwen3-Swallow-8B-RL-v0.2, converted and quantized using llama.cpp version 8114.
Downloads · 30 days
199
15% of all-time downloads
All-time downloads
1.3K
Public
Repo size
5 GB
Likes
2
Public
Click a slice to open those files.
.gguf5 GB · 100%
From the Hugging Face model README
This is a static Q4_K_M quantized GGUF version of tokyotech-llm/Qwen3-Swallow-8B-RL-v0.2, converted and quantized using llama.cpp version 8114.
llama-cli -m Qwen3-Swallow-8B-RL-v0.2-Q4_K_M.gguf -cnv --temp 0.6 --top-p 0.95 --top-k 20 -c 4096
Apache License 2.0 — same as the base model.