Downloads · 30 days
0
safe-flat-lora-baseline-qwen2.5-1.5b-instruct-lora
mahdiboughrous/safe-flat-lora-baseline-qwen2.5-1.5b-instruct-lora
safe-flat-lora-baseline-qwen2.5-1.5b-instruct-lora is a machine learning model from mahdiboughrous. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Part of the Safe-Flat-LoRA project (the Safety-Flatness Paradox in 4-bit quantization of LoRA-fine-tuned LLMs -- see the project blueprint for the full motivation and methodology).
Access
Public
Updated Jul 8, 2026
Repo size
48.4 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors37 MB · 76%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jul 8, 2026
- Updated
- Jul 8, 2026
- SHA
- bdf6bc0e
Base models
Model card
From the Hugging Face model README
mahdiboughrous/safe-flat-lora-baseline-qwen2.5-1.5b-instruct-lora
Part of the Safe-Flat-LoRA project (the Safety-Flatness Paradox in 4-bit quantization of LoRA-fine-tuned LLMs -- see the project blueprint for the full motivation and methodology).
- Base model:
Qwen/Qwen2.5-1.5B-Instruct - Method:
baseline(plain LoRA fine-tune, used as the pre-Flat-LoRA baseline) - Artifact: lora
- Fine-tuning task: SQL generation (
b-mc2/sql-create-context), used as a downstream-task proxy to study how post-training 4-bit (NF4) quantization shifts safety-refusal behavior after LoRA fine-tuning.
Base model Qwen2.5-1.5B-Instruct is Apache-2.0.
- License
- apache-2.0
- Created
- Jul 8, 2026
- Updated
- Jul 8, 2026