Downloads · 30 days
4
11% of all-time downloads
viennh2012/cinemr-cardiac-sft
cinemr-cardiac-sft is a image-text-to-text model from viennh2012. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
PEFT LoRA checkpoint from the first supervised fine-tuning epoch on top of Qwen/Qwen3-VL-8B-Instruct. This folder is not a full merged model: it contains adapter weights, tokenizer/processor configs, chat template, an…
Downloads · 30 days
4
11% of all-time downloads
All-time downloads
37
Public
Repo size
186 MB
Likes
0
Public
Click a slice to open those files.
.safetensors175 MB · 94%
From the Hugging Face model README
PEFT LoRA checkpoint from the first supervised fine-tuning epoch on top of Qwen/Qwen3-VL-8B-Instruct. This folder is not a full merged model: it contains adapter weights, tokenizer/processor configs, chat template, and a small tool-decision auxiliary head used during training.
| File | Role |
|---|---|
adapter_model.safetensors | LoRA weights |
adapter_config.json | PEFT metadata (peft_version, r, lora_alpha, target_modules, …) |
tokenizer.json, tokenizer_config.json | Tokenizer |
processor_config.json | Qwen3VLProcessor (image + video blocks; processor_class: Qwen3VLProcessor) |
chat_template.jinja | Chat template |
tool_decision_head.pt | Auxiliary classifier weights (tool_decision_aux) |
tool_decision_head.json | Head spec (hidden_size, kind) |
adapter_config.json)| Field | Value |
|---|---|
| PEFT | LoRA, task_type: CAUSAL_LM |
| Base | Qwen/Qwen3-VL-8B-Instruct |
| Rank / α / dropout | r=16, lora_alpha=32, lora_dropout=0.05 |
| Target modules | q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj |
| Vision | No exclude_modules — vision + language linear targets follow PEFT defaults for this export |
| PEFT version | 0.18.1 |
import torch
from transformers import AutoModelForVision2Seq, AutoProcessor
from peft import PeftModel
base_id = "Qwen/Qwen3-VL-8B-Instruct"
adapter_dir = "." # path to this `epoch0` directory
base = AutoModelForVision2Seq.from_pretrained(
base_id,
torch_dtype=torch.bfloat16,
device_map="auto",
trust_remote_code=True,
)
model = PeftModel.from_pretrained(base, adapter_dir, is_trainable=False)
processor = AutoProcessor.from_pretrained(adapter_dir, trust_remote_code=True)
Match torch_dtype / device_map to your inference or merge pipeline. The tool_decision_head.pt head is not loaded by PeftModel.from_pretrained; if your runtime expects it, load it with the same training code path that produced this checkpoint.
Merged full-weight exports used elsewhere in this tree (e.g. Data/cardiac_outputs/sft_merged_easyr1) may combine multiple SFT stages; this epoch0 snapshot is the first-epoch LoRA only. Align training data and licenses with your Cardiac / VLM SFT recipe.
Use consistent with Qwen3-VL, PEFT, and the datasets you used for SFT.
@misc{cinemr_sft_epoch0_lora_qwen3vl8b,
title = {CineMR SFT epoch 0 --- LoRA on Qwen3-VL-8B-Instruct},
howpublished = {Local PEFT adapter export},
year = {2026},
note = {Includes tool\_decision\_head auxiliary checkpoint},
}