Downloads · 30 days
0
carnice-9b
hipfire-models/carnice-9b
carnice-9b is a text generation model from hipfire-models. Use it when you need the model to write or continue text. It is set up for hermes. The card lists the license as apache-2.0.
kai-os/Carnice-9b quantized for hipfire, a Rust-native inference engine for AMD RDNA GPUs.
Access
Public
Updated Apr 13, 2026
Repo size
24.7 GB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.hf67.3 GB · 30%
At a glance
- Task
- Text Generation
- Library
- hermes
- License
- apache-2.0
- Access
- Public
- Created
- Apr 5, 2026
- Updated
- Apr 13, 2026
- SHA
- 28018dc4
Try a prompt
Base models
Model card
From the Hugging Face model README
Carnice-9B — hipfire quantized
kai-os/Carnice-9b quantized for hipfire, a Rust-native inference engine for AMD RDNA GPUs.
Carnice is a Hermes tool-use finetune of Qwen3.5-9B with browser, terminal, and reasoning capabilities.
Files
| File | Quant | Size | Speed (5700 XT) | Notes |
|---|---|---|---|---|
carnice-9b.hf4 | HF4 (4-bit) | 4.5 GB | ~41 tok/s | Faster, fits 8GB VRAM |
carnice-9b.hf6 | HF6 (6-bit) | 6.9 GB | ~32 tok/s | Better quality, needs 8GB |
Usage
# Install hipfire
curl -L https://raw.githubusercontent.com/Kaden-Schutt/hipfire/master/scripts/install.sh | bash
# Pull and run
hipfire pull carnice:9b # HF4 (default)
hipfire pull carnice:9b-hf6 # HF6 (higher quality)
hipfire run carnice:9b
About
Carnice uses the Hermes chat template with <tool_call> XML tags for function calling. hipfire passes these through as regular tokens — the model generates tool calls naturally within the ChatML format.
Same DeltaNet hybrid architecture as base Qwen3.5. JIT-compiles for any AMD GPU (RDNA 1-4, APUs).
License
Apache 2.0
- Task
- Text Generation
- Library
- hermes
- License
- apache-2.0
- Languages
- en
- Created
- Apr 5, 2026
- Updated
- Apr 13, 2026