Downloads · 30 days
3
5% of all-time downloads
enpeizhao/qwen3-8b-instruct-trl-sft-20-bf16-merged
qwen3-8b-instruct-trl-sft-20-bf16-merged is a image-text-to-text model from enpeizhao. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fine-tuned version of Qwen/Qwen3-VL-8B-Instruct on a custom vision-language dataset.
Downloads · 30 days
3
5% of all-time downloads
All-time downloads
62
Public
Parameters
8.8B
17.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors17.5 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of Qwen/Qwen3-VL-8B-Instruct on a custom vision-language dataset.
The model was fine-tuned on a custom dataset containing vision-language pairs designed for specific downstream tasks.
The model was trained using LoRA with the following configuration:
This model can be used for vision-language understanding tasks, including:
from transformers import Qwen3VLForConditionalGeneration, AutoProcessor
import torch
# Load model and processor
model = Qwen3VLForConditionalGeneration.from_pretrained(
"enpeizhao/qwen3-8b-instruct-trl-sft-20-bf16-merged",
torch_dtype=torch.bfloat16,
device_map="auto"
)
processor = AutoProcessor.from_pretrained("enpeizhao/qwen3-8b-instruct-trl-sft-20-bf16-merged")
# Prepare input
messages = [
{
"role": "user",
"content": [
{"type": "image", "image": "path/to/image.jpg"},
{"type": "text", "text": "Describe this image in detail."}
]
}
]
text = processor.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = processor(text=[text], images=[image], return_tensors="pt").to(model.device)
# Generate
generated_ids = model.generate(**inputs, max_new_tokens=512)
output = processor.batch_decode(generated_ids, skip_special_tokens=True)
print(output[0])
If you use this model, please cite the original Qwen3-VL paper and acknowledge this fine-tuned version:
@article{qwen3vl2024,
title={Qwen3-VL: A Versatile Vision-Language Model},
author={Qwen Team},
year={2024}
}
This model card was created as part of a fine-tuning project.
For questions and feedback about this fine-tuned model, please open an issue in the model repository.