Downloads · 30 days
3
11% of all-time downloads
cyber-crisis-qwen2-lora
ArsheelPatel06/cyber-crisis-qwen2-lora
cyber-crisis-qwen2-lora is a reinforcement learning model from ArsheelPatel06. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
LoRA adapter trained with GRPO on the Adversarial Cyber Crisis Simulator (OpenEnv).
All-time downloads
28
Public
Repo size
20.3 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json11.4 MB · 56%
At a glance
- Task
- Reinforcement Learning
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Apr 26, 2026
- Updated
- Apr 26, 2026
- SHA
- ac27dd3c
Base models
Model card
From the Hugging Face model README
cyber-crisis-qwen2-lora
LoRA adapter trained with GRPO on the Adversarial Cyber Crisis Simulator (OpenEnv).
Base model
Qwen/Qwen2-0.5B-Instruct
Training details
| Config | Value |
|---|---|
| Method | GRPO (TRL GRPOTrainer) |
| Task | alert_triage — classify alerts real vs fake |
| Reward | env score in [0, 1] from CyberCrisisEnv |
| LoRA rank | 8 |
| LoRA alpha | 32 |
| Target modules | q/k/v/o/gate/up/down proj |
| Epochs | 1 |
| Steps | 5 |
| Hardware | T4 GPU (Google Colab) |
| Step-1 reward | 0.80 (above 0.56 heuristic baseline) |
Environment
Live OpenEnv API: https://arsheelpatel06-cyber-crisis.hf.space
openenv validate --url https://arsheelpatel06-cyber-crisis.hf.space
# → 6/6 criteria passed
Load the adapter
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2-0.5B-Instruct")
model = PeftModel.from_pretrained(base, "ArsheelPatel06/cyber-crisis-qwen2-lora")
tokenizer = AutoTokenizer.from_pretrained("ArsheelPatel06/cyber-crisis-qwen2-lora")
- Task
- Reinforcement Learning
- Library
- peft
- License
- apache-2.0
- Created
- Apr 26, 2026
- Updated
- Apr 26, 2026