grug-27b

grug-27b

grug get big brain now. 27B brain. biggest grug yet that actually work.

normal model think like this: "Okay, so the user wants me to carefully consider the best approach here. Let me think about this step by step..."

grug think like this: "Need parse date. Regex or datetime. datetime.strptime safer. Handle bad input, return None."

same reasoning. same depth. way fewer token. grug throw grammar padding in fire, keep all brain meat. answer come out normal english, full quality. only inside voice is grug.

what grug-27b is

• base: Qwen/Qwen3.6-27B (apache 2.0)
• method: LoRA r=32 on all text-stack linears, merged to bf16
• loss: think-only loss on trajectory data (grug never imitate old seed english say-word), full loss on fresh high-quality data
• data: grug-think-v3-10k agent trajectories + fresh gpt-5.5 set (hard math derivations, hard code design, chat, tool sessions) with dense adaptive grug think
• grug think short when task small. grug think LONG when task hard. length earned by real constraint, never by "carefully thinking" smoke.

why 27b not break like 35b

35b brother repeat words until cave fall down. grug study why. train data had think in every history turn. agent tool (OpenCode etc) throw old think away. model see world it never train on. model panic. model loop.

grug-27b train on BOTH world:

1. think-in-history trajectories (framework keep think)
2. stripped-history variants: old think gone, exactly like agent framework replay, only final turn trained

then grug run repetition stress gauntlet before release: greedy long-form generation, deep think-stripped agent replay, multi-turn continuation. numbers below. no loop, no repeat sickness.

see difference

same HumanEval problem (separate_paren_groups), both solve correct:

Qwen3.6-27B think: 6,539 tokens. start like this and keep going for pages:

The user wants a Python function separate_paren_groups that takes a string of parentheses and spaces, and returns a list of strings. Each string in the list should represent a balanced group of parentheses that is not nested within another group. Spaces should be ignored...

grug-27b think: 33 tokens. whole thing:

Strip spaces. Scan chars; depth counts open parens. When depth becomes 0 after a close, current group finished; append and reset. Empty input -> [].

same answer quality. 198x less think.

grug get smarter over time

grug no static rock. grug evolve. all number same harness, all data open.

v2.1 (2026-07-23) - the "grug reason with knowledge" update

• reddit hunter say grug think too thin on hard prey. hunter right. v2.1 teach ADAPTIVE depth: easy task tiny think, HARD task full deliberation in dense grug (all branches, edge cases, verification) - still 10-30x fewer token than base. rule: expert must able rebuild whole solution from think alone.
• long-hunt training: 1000+ real agent sessions up to 11k token. stuck-loop escape (same error three time = approach dead, SWITCH), sacred no-tool final summary (no more infinite verify), fresh think every turn (no echo mantra).
• unseen-surface proof vs "benchmaxx" talk: MATH-500 never touch any grug data pipeline in any form. number below same harness both model.
• | test | grug v1 | grug v2.1 | note | |---|---:|---:|---| | HumanEval | 87.8 | 87.2 | noise range, base=87.8 | | MBPP | 84.0 | 85.0 | base(truncation-hurt)=77.0 | | GSM8K | 95.5 | 95.5 | base=93.0 | | MATH-500 (unseen surface) | 68.0 | 68.7 | base@4k=40.7, base@12k budget=63.3 | | SWE tool valid / match / args | 97.1/92.6/100 | 97.1/92.6/100 | base=94.1/54.4/100 | | loops / think closed | 0 / 100% | 0 / 100% | 35b sickness still extinct | | hard-task think depth | 137 tok | 155 tok | deeper where it count |

prompt-stability receipt (HumanEval, add "You are a helpful assistant." system prompt): grug stay put 87.2 -> 88.4. base SWING 87.8 -> 97.6 (system prompt cut base rambling 4082 -> 1550 token). grug stable, base prompt-sensitive. both cell shown because grug hide nothing: with that prompt base beat grug on HumanEval while spending 8x token. grug trade tiny easy-bench points for 8-40x token saving and stability. MATH-500 show the trade win on hard unseen ground.

v1 (2026-07-22) - first grug-27b

• LoRA on Qwen3.6-27B, grug-think-v3 + fresh gpt-5.5 data, think-only loss on trajectories. HumanEval 87.8 (=base), MBPP 84 (+7), GSM8K 95.5 (+2.5), tool match 92.6 (+38.2), token spend -94..98%, zero loop in 43-gauntlet stress.
• known wart fixed in v2.1: think sometimes too thin on hard problems; over-verification in long agent sessions.

27b and 35b hunt same prey

both grug hunt HumanEval and sanitized MBPP. number show pass@1 percent. bold grug win that hunt.

number (v1 detail vs base, 2026-07-22 harness)

score (same harness, same sampling, same token caps)

token spend

repeat sickness check

"healthy" metric strict: flags any generation where some line repeat 3+ time. grug inspect every flagged case both sides: all is well-formed structured doc (endpoint list, markdown table) where repeated line is legit formatting. actual degenerate loops: zero, both models, all 43 gauntlets. 35b sickness not present. also note base MBPP number hurt by own verbosity: 41% of base MBPP runs hit the 6144-token cap before finishing. grug hit cap 0 times ever.

think dialect: think function-word ratio 22.4% (base) -> 3.4% (grug); planner-English phrases per run 9978 -> 0 across all benchmarks

how run

works everywhere Qwen3.6-27B works (transformers, vLLM >= 0.19, sglang, llama.cpp via grug-27b-gguf).

vllm serve ProCreations/grug-27b --max-model-len 32768 --reasoning-parser qwen3

from transformers import AutoModelForImageTextToText, AutoTokenizer
tok = AutoTokenizer.from_pretrained("ProCreations/grug-27b")
model = AutoModelForImageTextToText.from_pretrained(
    "ProCreations/grug-27b", dtype="bfloat16", device_map="auto")
msgs = [{"role": "user", "content": "Write a function that checks if a number is prime."}]
inputs = tok.apply_chat_template(msgs, add_generation_prompt=True, return_tensors="pt").to(model.device)
out = model.generate(inputs, max_new_tokens=512, temperature=0.6, top_p=0.95, top_k=20)
print(tok.decode(out[0][inputs.shape[1]:]))

sampling: temperature 0.6-1.0, top_p 0.95, top_k 20 (same as base). thinking mode on by default. MTP weights not included (config say mtp_num_hidden_layers=0); vision tower included, untouched from base.

huggingface inference endpoints

deploy as CUSTOM CONTAINER vllm/vllm-openai:latest for full OpenAI protocol: /v1/chat/completions with streaming and tool calling. important: the container command must be set on the endpoint model.command field (top level, NOT inside the image dict - API silently drop it there):

python3 -m vllm.entrypoints.openai.api_server --model ProCreations/grug-27b
  --served-model-name grug-27b --max-model-len 16384 --max-num-seqs 128
  --gpu-memory-utilization 0.90 --reasoning-parser qwen3
  --enable-auto-tool-choice --tool-call-parser qwen3_coder --port 8000

qwen3_coder parser speak grug XML call format; deepseek_r1 reasoning parser split grug think into message.reasoning (vLLM >= 0.25 field name; older call it reasoning_content). one A100-80GB enough even at 262k context with --kv-cache-dtype fp8. for agent frameworks set --max-model-len BIG (agent system prompts alone pass 8k token; 16k cap make every request fail).

from openai import OpenAI
client = OpenAI(base_url="https://<your-endpoint>.endpoints.huggingface.cloud/v1", api_key="hf_...")  # HF token
stream = client.chat.completions.create(
    model="grug-27b",
    messages=[{"role": "user", "content": "why sky blue?"}],
    stream=True)
for chunk in stream:
    d = chunk.choices[0].delta
    r = getattr(d, "reasoning", None) or getattr(d, "reasoning_content", None)
    if r: print(r, end="")
    if d.content: print(d.content, end="")

tools: pass standard OpenAI tools=[...], get tool_calls back parsed. old simple handler still in repo (handler.py) if someone want default toolkit deploy instead.

qat rock note

qat rock built from v1 weight (still excellent vs ordinary v1 Q4). v2.1 QAT refresh maybe come later.

qat rock

most cave use Q4. grug make special QAT version for Q4 people: grug-27b-qat-q4-gguf

• weights trained while feeling 4-bit rounding, better Q4 quality. use that one for Q4. this repo best for bf16/Q8/Q6/Q5.

grug family

• grug-v2-9b - small brother, 9B
• grug-27b - this grug
• grug-think-v3-10k - the brain box

grug made by ProCreations. grug thank Qwen team for very good base brain.