Downloads · 30 days
337
58% of all-time downloads
Zrald/Zrald-AI-qwen-3.8-27b-zraldv1-ba
Zrald-AI-qwen-3.8-27b-zraldv1-ba is a text generation model from Zrald. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Official high-efficiency GGUF release of Qwen3.8-27B optimized for Balanced Sweet-Spot Tier.
Downloads · 30 days
337
58% of all-time downloads
All-time downloads
581
Public
Repo size
15.5 GB
Likes
1
Public
Click a slice to open those files.
.gguf15.5 GB · 100%
From the Hugging Face model README
Official high-efficiency GGUF release of Qwen3.8-27B optimized for Balanced Sweet-Spot Tier.
This repository contains zraldv1-ba.gguf (14.46 GiB / 15.52 GB), physically benchmarked on AMD Instinct MI300X hardware.
For cross-comparison tables against standard Q8_0, Q6_K, Q5_K, Q4_K, and Q2_K models, visit the master repository: 👉 Zrald/Zrald-AI-model-quant-qwen-3.8-27b
huggingface-cli download Zrald/Zrald-AI-qwen-3.8-27b-zraldv1-ba zraldv1-ba.gguf --local-dir ./models
./build/bin/llama-cli \
-m ./models/zraldv1-ba.gguf \
-ngl 99 \
-c 4096 \
-p "<|im_start|>user\nSolve 15 * 14 step-by-step.<|im_end|>\n<|im_start|>assistant\n" \
-n 128 \
--single-turn
./build/bin/llama-cli \
-m ./models/zraldv1-ba.gguf \
-ngl 99 \
-c 8192 \
-cnv
./build/bin/llama-server \
-m ./models/zraldv1-ba.gguf \
-ngl 99 \
-c 16384 \
--host 0.0.0.0 \
--port 8080