Downloads · 30 days
7
21% of all-time downloads
ggufs/mantis-m1-flash-lora
mantis-m1-flash-lora is a machine learning model from ggufs. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
A concise vision-language model built by ggufs on top of Qwen2.5-VL-7B-Instruct.
Downloads · 30 days
7
21% of all-time downloads
All-time downloads
33
Public
Repo size
334 MB
Likes
0
Public
Click a slice to open those files.
.safetensors323 MB · 97%
From the Hugging Face model README
A concise vision-language model built by ggufs on top of Qwen2.5-VL-7B-Instruct.
[flash] prefix: gives direct answers with internal reasoning[think] prefix: shows full reasoning steps before the answerfrom transformers import AutoModelForImageTextToText, AutoProcessor
from peft import PeftModel
model = AutoModelForImageTextToText.from_pretrained("Qwen/Qwen2.5-VL-7B-Instruct", dtype="bfloat16", device_map="auto")
model = PeftModel.from_pretrained(model, "ggufs/mantis-m1-flash-lora")