Downloads · 30 days
22
46% of all-time downloads
siddharthvader/wikigame-qwen3-8b-fireworks-rft-poc
wikigame-qwen3-8b-fireworks-rft-poc is a text generation model from siddharthvader. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
This is a proof-of-concept rank-16 LoRA adapter for choosing valid outgoing English Wikipedia links that move toward a target article. It was warm-started from a Fireworks SFT adapter and then trained with Fireworks m…
Downloads · 30 days
22
46% of all-time downloads
All-time downloads
48
Public
Repo size
87.4 MB
Likes
0
Public
Click a slice to open those files.
.safetensors87.4 MB · 100%
From the Hugging Face model README
This is a proof-of-concept rank-16 LoRA adapter for choosing valid outgoing English Wikipedia links that move toward a target article. It was warm-started from a Fireworks SFT adapter and then trained with Fireworks managed RFT/GRPO using a controlled step-level reward.
The training set contains 23 successful GPT-5.6 teacher states from eight navigation episodes. RFT sampled eight candidates per state. Of 23 groups, 14 had non-zero reward variance; the 184 candidate rewards were 18 at 0.0, 92 at 0.1, 22 at 0.8, and 52 at 1.0.
On five small held-out two-click tasks, the adapter achieved 100% success, SPL 0.933, 2.2 mean clicks, and zero invalid clicks. Untuned Qwen3-8B and the SFT checkpoint achieved the same task metrics, so this POC validates the end-to-end RFT and serving workflow but does not demonstrate a quality improvement from RFT. A larger and harder held-out benchmark is required.
Load with PEFT on top of Qwen/Qwen3-8B. For Fireworks Qwen3 inference, disable
thinking with reasoning_effort="none" when a short JSON action is required. The
policy was trained to emit page_title, while the reward/evaluator also accepted the
observed next_title alias.
The runtime must enforce valid-link constraints and the game rules; model output alone is not a security boundary. This adapter is narrowly trained, experimental, and can still select irrelevant or invalid links outside the small POC distribution.