GenPRM-7B-GGUF

GenPRM-7B-GGUF

GGUF quantizations of GenPRM/GenPRM-7B, a generative process reward model for mathematical reasoning.

Model Details

GenPRM-7B is a Qwen2-based process reward model trained from the DeepSeek-R1-Distill-Qwen-7B base model. It performs explicit chain-of-thought reasoning and code verification before producing process judgments. It supports test-time scaling through parallel generation and majority voting, and can be used as a verifier or critic.

Quantizations

Actual requirements depend on context length, KV cache, and runtime configuration.

Hardware Compatibility

Usage

llama.cpp

llama-cli -hf tinyopsec/GenPRM-7B-GGUF:Q4_K_M

Server:

llama-server -hf tinyopsec/GenPRM-7B-GGUF:Q4_K_M

llama-cpp-python

from llama_cpp import Llama

llm = Llama(
    model_path="model_q4_k_m.gguf",
    n_ctx=8192,
)

output = llm(
    "Review the following mathematical solution step by step.",
    max_tokens=2048,
)
print(output)

LM Studio

Download the desired GGUF file and load it through LM Studio.

Ollama

ollama run hf.co/tinyopsec/GenPRM-7B-GGUF:Q4_K_M

Original Model

GenPRM/GenPRM-7B

GenPRM was introduced in GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning. The model uses explicit reasoning and verification for process supervision and supports both verifier and critic applications.

Features

• Generative process reward model
• Mathematical reasoning and process supervision
• Explicit chain-of-thought reasoning
• Code verification
• Relative Progress Estimation (RPE)
• Parallel test-time scaling
• Majority-vote verification
• Critique and refinement support
• Qwen2 architecture
• GGUF format for llama.cpp-compatible runtimes

Citation

@article{zhao2025genprm,
  title   = {GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning},
  author  = {Jian Zhao and Runze Liu and Kaiyan Zhang and Zhimu Zhou and Junqi Gao and Dong Li and Jiafei Lyu and Zhouyi Qian and Biqing Qi and Xiu Li and Bowen Zhou},
  journal = {arXiv preprint arXiv:2504.00891},
  year    = {2025}
}

Links

• Original model: https://huggingface.co/GenPRM/GenPRM-7B
• GGUF repo: https://huggingface.co/tinyopsec/GenPRM-7B-GGUF