Downloads · 30 days
0
hamzamooraj99/MedQA-Qwen-2B-LoRA16
MedQA-Qwen-2B-LoRA16 is a machine learning model from hamzamooraj99. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Fine-tuned Qwen2-VL-2B on PMC-VQA (version 1) for Medical Visual Question Answering. Uses LoRA (rank=16) to adapt vision and language layers.
Downloads · 30 days
0
Access
Public
Updated Mar 16, 2025
Repo size
127 MB
Likes
0
Public
Click a slice to open those files.
.safetensors116 MB · 88%
From the Hugging Face model README
Fine-tuned Qwen2-VL-2B on PMC-VQA (version 1) for Medical Visual Question Answering. Uses LoRA (rank=16) to adapt vision and language layers.
Figure_path: | The filename of the corresponding image (e.g., "PMC_1.jpg"). |
| Question: | The medical question related to the image. |
| Answer: | The correct answer to the question. |
| Choice A: | Option A for the multiple-choice question. |
| Choice B: | Option B for the multiple-choice question. |
| Choice C: | Option C for the multiple-choice question. |
| Choice D: | Option D for the multiple-choice question. |
| Answer_label: | The index label of the correct answer choice (A, B, C, D). |
| image: | The actual image data, stored as a PIL Image object. | # Provide a detailed description of your dataset.max_pixels = 256x256, min_pixels = 224x224| Step | Training Loss | Validation Loss |
|---|---|---|
| 9000 | 0.877100 | 0.778581 |
| 10000 | 0.742300 | 0.774723 |
| 11000 | 0.749400 | 0.772927 |
| 12000 | 0.857600 | 0.769148 |
| 13000 | 0.786700 | 0.766358 |
| 14000 | 0.717500 | 0.765929 |
| 15000 | 0.737700 | 0.764269 |
✅ Stable training with minimal overfitting observed.
❌ Training was resumed from a checkpoint due to a hardware timeout, which might have affected overall training efficiency.
This qwen2_vl model was trained 2x faster with Unsloth and Huggingface's TRL library.