Downloads · 30 days
11
10% of all-time downloads
ddevMhrn/Qwen2.5-7B-Viveka
Qwen2.5-7B-Viveka is a machine learning model from ddevMhrn. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
LoRA adapter trained on the Viveka OpenEnv with TRL GRPO + Unsloth 4-bit QLoRA. Six-component deterministic reward over mocked Indian DPI services (UPI, DigiLocker, IRCTC, Banking, Telecom). 200 episodes, tier mix 1:0…
Downloads · 30 days
11
10% of all-time downloads
All-time downloads
111
Public
Repo size
173 MB
Likes
0
Public
Click a slice to open those files.
.safetensors162 MB · 93%
From the Hugging Face model README
LoRA adapter trained on the Viveka OpenEnv with TRL GRPO + Unsloth 4-bit QLoRA. Six-component deterministic reward over mocked Indian DPI services (UPI, DigiLocker, IRCTC, Banking, Telecom). 200 episodes, tier mix 1:0.4 / 2:0.4 / 4:0.2.
Base model: Qwen/Qwen2.5-7B-Instruct
Notes: Same train.py config as the v6 Qwen-1.5B run. No OOM mitigations needed on T4 x2.
See github.com/DevMhrn/viveka-env for the env, reward design, and eval harness.