Downloads · 30 days
23
7% of all-time downloads
ermiaazarkhalili/reasoning-gym-chain-sum-qwen3-1-7b-grpo-GGUF
reasoning-gym-chain-sum-qwen3-1-7b-grpo-GGUF is a text generation model from ermiaazarkhalili. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
GGUF quantizations of ermiaazarkhalili/reasoning-gym-chain-sum-qwen3-1-7b-grpo, a GRPO (Group Relative Policy Optimization) reinforcement-learning fine-tune, converted with llama.cpp.
Downloads · 30 days
23
7% of all-time downloads
All-time downloads
310
Public
Repo size
4.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf4.2 GB · 100%
From the Hugging Face model README
GGUF quantizations of ermiaazarkhalili/reasoning-gym-chain-sum-qwen3-1-7b-grpo,
a GRPO (Group Relative Policy Optimization) reinforcement-learning fine-tune, converted
with llama.cpp.
| Field | Value |
|---|---|
| Source checkpoint | ermiaazarkhalili/reasoning-gym-chain-sum-qwen3-1-7b-grpo |
| Base model | Qwen/Qwen3-1.7B |
| Training | GRPO (group-relative RL) on the chain_sum arithmetic-reasoning task |
| Dataset / environment | OpenEnv reasoning_gym — chain_sum (agentic env) |
| Quantization tool | llama.cpp convert_hf_to_gguf.py + llama-quantize |
| File | Size | Notes |
|---|---|---|
reasoning-gym-chain-sum-qwen3-1-7b-grpo.q4_k_m.gguf | 1.11 GB (recommended) | 4-bit K-quant medium; best size/quality balance |
reasoning-gym-chain-sum-qwen3-1-7b-grpo.q5_k_m.gguf | 1.26 GB (balanced) | 5-bit K-quant medium; near-full quality |
reasoning-gym-chain-sum-qwen3-1-7b-grpo.q8_0.gguf | 1.83 GB (largest) | 8-bit; closest to the source precision |
Recommended default: Q4_K_M. For maximum fidelity use Q8_0.
# One-shot
llama-cli -hf ermiaazarkhalili/reasoning-gym-chain-sum-qwen3-1-7b-grpo-GGUF --jinja -p "Your prompt here" -n 256
# Interactive chat
llama-cli -hf ermiaazarkhalili/reasoning-gym-chain-sum-qwen3-1-7b-grpo-GGUF --jinja -cnv
ollama run hf.co/ermiaazarkhalili/reasoning-gym-chain-sum-qwen3-1-7b-grpo-GGUF:Q4_K_M
from llama_cpp import Llama
llm = Llama.from_pretrained(
repo_id="ermiaazarkhalili/reasoning-gym-chain-sum-qwen3-1-7b-grpo-GGUF",
filename="*q4_k_m.gguf",
n_ctx=4096,
)
out = llm.create_chat_completion(
messages=[{"role": "user", "content": "Your prompt here"}],
max_tokens=256,
)
print(out["choices"][0]["message"]["content"])
Research and non-commercial experimentation. This model was RL-tuned on the chain_sum arithmetic-reasoning task;
it is a reasoning demonstrator, not a general-purpose assistant. Verify outputs before
any downstream use.
Q8_0 when fidelity matters.ermiaazarkhalili/reasoning-gym-chain-sum-qwen3-1-7b-grpo).chain_sum arithmetic-reasoning task; capability on unrelated tasks is not guaranteed.@misc{reasoning_gym_chain_sum_qwen3_1_7b_grpo_gguf,
author = {Ermia Azarkhalili},
title = {reasoning-gym-chain-sum-qwen3-1.7b-grpo — GGUF quantized},
year = {2026},
publisher = {Hugging Face},
howpublished = {\url{https://huggingface.co/ermiaazarkhalili/reasoning-gym-chain-sum-qwen3-1-7b-grpo-GGUF}}
}