Downloads · 30 days
26
11% of all-time downloads
Zrald/Zrald-AI-qwen-3.8-27b-zraldv1-cs
Zrald-AI-qwen-3.8-27b-zraldv1-cs is a text generation model from Zrald. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Official high-efficiency GGUF release of Qwen3.8-27B optimized for Compressed Size Tier.
Downloads · 30 days
26
11% of all-time downloads
All-time downloads
231
Public
Repo size
10.9 GB
Likes
1
Public
Click a slice to open those files.
.gguf10.9 GB · 100%
From the Hugging Face model README
Official high-efficiency GGUF release of Qwen3.8-27B optimized for Compressed Size Tier.
This repository contains zraldv1-cs.gguf (10.18 GiB / 10.93 GB), physically benchmarked on AMD Instinct MI300X hardware.
For cross-comparison tables against standard Q8_0, Q6_K, Q5_K, Q4_K, and Q2_K models, visit the master repository: 👉 Zrald/Zrald-AI-model-quant-qwen-3.8-27b
huggingface-cli download Zrald/Zrald-AI-qwen-3.8-27b-zraldv1-cs zraldv1-cs.gguf --local-dir ./models
./build/bin/llama-cli \
-m ./models/zraldv1-cs.gguf \
-ngl 99 \
-c 4096 \
-p "<|im_start|>user\nSolve 15 * 14 step-by-step.<|im_end|>\n<|im_start|>assistant\n" \
-n 128 \
--single-turn
./build/bin/llama-cli \
-m ./models/zraldv1-cs.gguf \
-ngl 99 \
-c 8192 \
-cnv
./build/bin/llama-server \
-m ./models/zraldv1-cs.gguf \
-ngl 99 \
-c 16384 \
--host 0.0.0.0 \
--port 8080