Downloads · 30 days
10
30% of all-time downloads
R-Search-3b-ppo
qingfei1/R-Search-3b-ppo
R-Search-3b-ppo is a machine learning model from qingfei1. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
<p align="center" 🤗 <a href="https://huggingface.co/datasets/qingfei1/R-Searchdatasets" target="blank"[R-Search Datasets] </a • 💻 <a href="https://github.com/QingFei1/R-Search" target="blank"[Github Repo]</a </p
All-time downloads
33
Public
Parameters
3.4B
13.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors13.6 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Jun 4, 2025
- Updated
- Jun 4, 2025
- SHA
- 0e27a3c2
Datasets
Model card
From the Hugging Face model README
R-Search: Empowering LLM Reasoning with Search via Multi-Reward Reinforcement Learning
<p align="center"> 🤗 <a href="https://huggingface.co/datasets/qingfei1/R-Search_datasets" target="_blank">[R-Search Datasets] </a> • 💻 <a href="https://github.com/QingFei1/R-Search" target="_blank">[Github Repo]</a> </p>R-Search is a novel reinforcement learning framework for reasoning–search integration. It enables LLMs to autonomously perform multi-step reasoning with deep search interaction, and to learn optimal reasoning–search trajectories via multi-reward signals, substantially improving performance on complex logic- and knowledge-intensive tasks.
Trained Models
We open-sourced the following models trained only on the 2wikimultihopqa training set:
| Model | Huggingface Repo | Description |
|---|---|---|
| R-Search-7b-grpo | 🤗 Huggingface Repo | Trained Qwen2.5-7B-Instruct using the GRPO algorithm |
| R-Search-3b-grpo | 🤗 Huggingface Repo | Trained Qwen2.5-3B-Instruct using the GRPO algorithm |
| R-Search-7b-ppo | 🤗 Huggingface Repo | Trained Qwen2.5-7B-Instruct using the PPO algorithm |
| R-Search-3b-ppo | 🤗 Huggingface Repo | Trained Qwen2.5-3B-Instruct using the PPO algorithm |
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Jun 4, 2025
- Updated
- Jun 4, 2025