Downloads · 30 days
7
33% of all-time downloads
medquad-lora-r4-best-v2
CHF0101/medquad-lora-r4-best-v2
medquad-lora-r4-best-v2 is a machine learning model from CHF0101. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
- Base: mistralai/Mistral-7B-Instruct-v0.3 - LoRA r: 4 - Módulos: qproj, kproj, vproj - 4-bit NF4 - Early Stopping: patience=3 Training logs (manual, Epoch estimado, 150 max steps): - BertScore F1 (sample test 50): 0.…
All-time downloads
21
Public
Repo size
29.1 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt19 MB · 58%
At a glance
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Nov 2, 2025
- Updated
- Nov 2, 2025
- SHA
- 4a61de6c
Model card
From the Hugging Face model README
MedQuAD LoRA r=4
Configuración
- Base:
mistralai/Mistral-7B-Instruct-v0.3 - LoRA r: 4
- Módulos: q_proj, k_proj, v_proj
- 4-bit NF4
- Early Stopping: patience=3
Entrenamiento
Training logs (manual, Epoch estimado, 150 max steps):
| Step | Epoch | Training Loss | Validation Loss |
|---|---|---|---|
| 50 | 0.023 | 0.710800 | 0.791143 |
| 100 | 0.046 | 0.672000 | 0.788682 |
| 150 | 0.070 | 0.648600 | 0.774913 |
Evaluación
- BertScore F1 (sample test 50): 0.8451
Uso
from peft import PeftModel
from transformers import AutoModelForCausalLM
base = AutoModelForCausalLM.from_pretrained('mistralai/Mistral-7B-Instruct-v0.3', load_in_4bit=True)
model = PeftModel.from_pretrained(base, 'CHF0101/medquad-lora-r4-best-v2')
- Library
- peft
- License
- apache-2.0
- Languages
- en
- Created
- Nov 2, 2025
- Updated
- Nov 2, 2025