Downloads · 30 days
22
3% of all-time downloads
ponytang3/Carnice-9b-heretic
Carnice-9b-heretic is a text generation model from ponytang3. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
22
3% of all-time downloads
All-time downloads
670
Public
Parameters
9B
17.9 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors17.9 GB · 100%
From the Hugging Face model README
| Parameter | Value |
|---|---|
| direction_index | 16.62 |
| attn.o_proj.max_weight | 2.45 |
| attn.o_proj.max_weight_position | 24.36 |
| attn.o_proj.min_weight | 2.28 |
| attn.o_proj.min_weight_distance | 17.98 |
| mlp.down_proj.max_weight | 1.51 |
| mlp.down_proj.max_weight_position | 22.60 |
| mlp.down_proj.min_weight | 0.74 |
| mlp.down_proj.min_weight_distance | 16.08 |
| Metric | This model | Original model (a model) |
|---|---|---|
| KL divergence | 0.0095 | 0 (by definition) |
| Refusals | 6/100 | 88/100 |

This model would not have been possible without the contributions of Teknium, (Nous Research), Zachary Mueller, (Lambda).
Carnice-9b is a standalone merged model tuned specifically for the Hermes Agent harness.
It is built on top of Qwen/Qwen3.5-9B, but the training target here was not generic chat quality or leaderboard chasing. The goal was to improve behavior inside Hermes Agent itself: tool calling, terminal use, browser use, multi-step execution, and the exact message patterns the Hermes harness expects.
This repo is the direct-load merged checkpoint form of kai-os/qwen35-hermes-stage2-adapter-v1. It loads as its own model without a separate PEFT adapter step.
Important detail: this is a merged standalone checkpoint, not a separate full-parameter training run from scratch.
Carnice-9b was trained in two stages.
The second stage is the important part for this release. Instead of teaching a generic external tool schema, it was trained on data shaped for the Hermes Agent environment itself.
Carnice-9b is intended for Hermes Agent first.
It was tuned around workflows such as:
A major design constraint during training was to avoid teaching the model foreign agent habits that would make it awkward inside the Hermes harness.
The Hermes-specialized stage draws primarily from:
open-thoughts/OpenThoughts-Agent-v1-SFTThe earlier repair stage uses a smaller reasoning mix centered on:
bespokelabs/Bespoke-Stratos-17kAI-MO/NuminaMath-CoTThe release intentionally centers harness-native behavior over broad generic benchmark optimization.
This model is being evaluated primarily inside Hermes Agent rather than through generic standalone chat benchmarks.
The main evaluation focus is official Hermes-compatible benchmark paths and harness-native runs. Partial one-shot numbers exist, but this card intentionally does not center them. For this release, the important point is what the model was optimized for: Hermes Agent execution quality, not shallow benchmark cosmetics.
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model_id = "kai-os/carnice-v1-9b-hermes-agent-stage2-merged"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.bfloat16,
device_map="auto",
)