Downloads · 30 days
116
22% of all-time downloads
JamieBradfield/qwen3.8-9b-hermes-fc-balanced-GGUF
qwen3.8-9b-hermes-fc-balanced-GGUF is a text generation model from JamieBradfield. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Downloads · 30 days
116
22% of all-time downloads
All-time downloads
518
Public
Repo size
4.9 GB
Likes
1
Public
Click a slice to open those files.
.gguf4.9 GB · 100%
From the Hugging Face model README
ROCmFPX-quantized GGUF of the balanced v26 fine-tune (qwen3.8-9b-hermes-fc-balanced).
qwen3.8-9b-hf-fc-v26-Q4_0_ROCMFP4_FAST.gguf — Q4_0 with ROCmFP4 fast
kernels (AMD RDNA3). Target: ROCm llama.cpp inference on RX 7000-series GPUs.From the BF16 merge in the parent repo, using the llama-rocmfpx fork:
# 1. convert safetensors -> BF16 GGUF
python C:/AI/llama-rocmfpx/convert_hf_to_gguf.py <merged-dir> --outtype bf16
# 2. quantize BF16 -> Q4_0_ROCMFP4_FAST (ROCm 7.1 env; BF16 source needs no
# --allow-requantize)
C:/AI/llama-rocmfpx/build-rdna3/bin/llama-quantize <src.gguf> <out.gguf> Q4_0_ROCMFP4_FAST
Served with --ctx-size 245760 --n-gpu-layers 99 --flash-attn on -ctk q8_0 -ctv turbo3.