Downloads · 30 days
161
21% of all-time downloads
qwen3.8-9b-hermes-function-calling-v1-GGUF
JamieBradfield/qwen3.8-9b-hermes-function-calling-v1-GGUF
qwen3.8-9b-hermes-function-calling-v1-GGUF is a text generation model from JamieBradfield. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
All-time downloads
758
Public
Repo size
4.9 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf4.9 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Aug 20, 2026
- Updated
- Oct 30, 2026
- SHA
- a5ad99a1
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.8-9B Hermes FC v1 — GGUF (ROCmFPX)
ROCmFPX quantized GGUF of the BF16 merge.
Files
| file | quant | size |
|---|---|---|
qwen3.8-9b-hf-fc-Q4_0_ROCMFP4_FAST.gguf | Q4_0_ROCMFP4_FAST | 4.92 GB |
Notes
- ROCmFPX quants use ROCMFP4 kernels from the
llama-rocmfpxfork (AMD RDNA3 / RX 7700 XT). Not portable to CUDA or CPU-only builds without the fork's kernels. - MTP (multi-token prediction) head is preserved in the GGUF.
- Converted from the BF16 merge with
convert_hf_to_gguf.py --outtype bf16, quantized withllama-quantize --allow-requantize Q4_0_ROCMFP4_FAST. - Model card and benchmark numbers: see the base-model repo.
- Task
- Text Generation
- License
- apache-2.0
- Created
- Aug 20, 2026
- Updated
- Oct 30, 2026