Downloads · 30 days
9
18% of all-time downloads
autoRiver/SAKI-InternVL3-2B-Instruct-bnb-4bit
SAKI-InternVL3-2B-Instruct-bnb-4bit is a image-text-to-text model from autoRiver. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Serialized BitsAndBytes NF4 4-bit checkpoint derived from OpenGVLab/InternVL3-2B-Instruct at revision f6c7b60375759170fd49f5e9e298e2178485c5ba.
Downloads · 30 days
9
18% of all-time downloads
All-time downloads
50
Public
Parameters
2.1B
1.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1.8 GB · 99%
How the weights are stored.
U81.7B · 78%
From the Hugging Face model README
Serialized BitsAndBytes NF4 4-bit checkpoint derived from OpenGVLab/InternVL3-2B-Instruct at revision f6c7b60375759170fd49f5e9e298e2178485c5ba.
{
"bnb_4bit_compute_dtype": "bfloat16",
"bnb_4bit_quant_type": "nf4",
"bnb_4bit_use_double_quant": true,
"load_in_4bit": true
}
Load with trust_remote_code=True, device_map="auto", and torch_dtype="auto".