Downloads · 30 days
15
28% of all-time downloads
ddevMhrn/Llama-3.1-8B-Viveka
Llama-3.1-8B-Viveka is a machine learning model from ddevMhrn. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
LoRA adapter trained on the Viveka OpenEnv with TRL GRPO + Unsloth 4-bit QLoRA. Six-component deterministic reward over mocked Indian DPI services (UPI, DigiLocker, IRCTC, Banking, Telecom). 200 episodes, tier mix 1:0…
Downloads · 30 days
15
28% of all-time downloads
All-time downloads
53
Public
Repo size
185 MB
Likes
0
Public
Click a slice to open those files.
.safetensors168 MB · 90%
From the Hugging Face model README
LoRA adapter trained on the Viveka OpenEnv with TRL GRPO + Unsloth 4-bit QLoRA. Six-component deterministic reward over mocked Indian DPI services (UPI, DigiLocker, IRCTC, Banking, Telecom). 200 episodes, tier mix 1:0.4 / 2:0.4 / 4:0.2.
Base model: meta-llama/Llama-3.1-8B-Instruct
Notes: Cross-family scale test. Eval uses Unsloth's open 4-bit mirror because meta-llama is gated; the LoRA was trained against the canonical weights (via Unsloth's auto-redirect).
See github.com/DevMhrn/viveka-env for the env, reward design, and eval harness.