Downloads · 30 days
6
27% of all-time downloads
medquad-lora-r32-best-v2
CHF0101/medquad-lora-r32-best-v2
medquad-lora-r32-best-v2 is a machine learning model from CHF0101. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
- Base: mistralai/Mistral-7B-Instruct-v0.3 - LoRA r: 32 - Módulos: qproj, kproj, vproj - 4-bit NF4 - Early Stopping: patience=3 Training logs (manual, Epoch estimado, 150 max steps): - BertScore F1 (sample test 50): 0…
All-time downloads
22
Public
Repo size
227 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt151 MB · 65%
At a glance
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Nov 2, 2025
- Updated
- Nov 2, 2025
- SHA
- 8d73f03c
Model card
From the Hugging Face model README
MedQuAD LoRA r=32
Configuración
- Base:
mistralai/Mistral-7B-Instruct-v0.3 - LoRA r: 32
- Módulos: q_proj, k_proj, v_proj
- 4-bit NF4
- Early Stopping: patience=3
Entrenamiento
Training logs (manual, Epoch estimado, 150 max steps):
| Step | Epoch | Training Loss | Validation Loss |
|---|---|---|---|
| 50 | 0.023 | 0.882800 | 0.845063 |
| 100 | 0.046 | 0.805700 | 0.784524 |
| 150 | 0.070 | 0.754400 | 0.767385 |
Evaluación
- BertScore F1 (sample test 50): 0.8452
Uso
from peft import PeftModel
from transformers import AutoModelForCausalLM
base = AutoModelForCausalLM.from_pretrained('mistralai/Mistral-7B-Instruct-v0.3', load_in_4bit=True)
model = PeftModel.from_pretrained(base, 'CHF0101/medquad-lora-r32-best-v2')
- Library
- peft
- License
- apache-2.0
- Languages
- en
- Created
- Nov 2, 2025
- Updated
- Nov 2, 2025