Downloads · 30 days
44
14% of all-time downloads
build-small-hackathon/mind-of-tashi-micro-grpo-gguf
mind-of-tashi-micro-grpo-gguf is a text generation model from build-small-hackathon. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
The GRPO-trained student exported to GGUF for llama.cpp. Drop-in replacement for the SFT GGUF in the playable Space after an A/B (winning the game is not enough — the mind-scroll prose must hold up). Transformers sour…
Downloads · 30 days
44
14% of all-time downloads
All-time downloads
318
Public
Repo size
1 GB
Likes
0
Public
Click a slice to open those files.
.gguf1 GB · 100%
From the Hugging Face model README
The GRPO-trained student exported to GGUF for llama.cpp. Drop-in
replacement for the SFT GGUF in the playable
Space
after an A/B (winning the game is not enough — the mind-scroll prose must
hold up). Transformers source:
…/mind-of-tashi-micro-grpo.
Build status: this GGUF is built at push time from the GRPO checkpoint — it does not exist as a by-product of training. Use the exact same recipe as the SFT GGUF.
| File | Approx size | Use |
|---|---|---|
mind-of-tashi-micro-grpo-Q4_K_M.gguf | ~256 MB | deployed candidate |
mind-of-tashi-micro-grpo-f16.gguf | ~786 MB | zero-loss reference |
chat_template.jinja
(a missing template silently yields a garbage GGUF).python convert_hf_to_gguf.py <ckpt> --outtype f16 → f16 GGUF.llama-cpp-python C binding:
import ctypes, llama_cpp
p = llama_cpp.llama_model_quantize_default_params()
p.ftype = 15 # LLAMA_FTYPE_MOSTLY_Q4_K_M
llama_cpp.llama_model_quantize(b"in-f16.gguf", b"out-Q4_K_M.gguf", ctypes.byref(p))
llama-cpp-python (the real deploy path);
ship Q4 if it clears ≥15/20 and stays within ~5 ladder points of f16.norm_topk_prob — required for llama.cppInherited norm_topk_prob=true from SFT; llama.cpp's qwen3moe graph
hardcodes norm_w=true and a mismatched checkpoint produces garbage on every
llama.cpp runtime. (See the SFT GGUF card.)
from llama_cpp import Llama
llm = Llama.from_pretrained(
repo_id="build-small-hackathon/mind-of-tashi-micro-grpo-gguf",
filename="mind-of-tashi-micro-grpo-Q4_K_M.gguf",
n_ctx=4096, n_gpu_layers=0, logits_all=True,
)
Game Space · self-play dataset · SFT model + GGUF · OpenEnv gym ·
GRPO model + GGUF (this) — all under build-small-hackathon/mind-of-tashi-*.