Downloads · 30 days
11
17% of all-time downloads
autoRiver/SAKI-InternVL3-2B-Instruct-bnb-8bit
SAKI-InternVL3-2B-Instruct-bnb-8bit is a image-text-to-text model from autoRiver. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Serialized BitsAndBytes LLM.int8 8-bit checkpoint derived from OpenGVLab/InternVL3-2B-Instruct at revision f6c7b60375759170fd49f5e9e298e2178485c5ba.
Downloads · 30 days
11
17% of all-time downloads
All-time downloads
66
Public
Parameters
2.1B
2.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.6 GB · 99%
How the weights are stored.
I81.6B · 78%
From the Hugging Face model README
Serialized BitsAndBytes LLM.int8 8-bit checkpoint derived from OpenGVLab/InternVL3-2B-Instruct at revision f6c7b60375759170fd49f5e9e298e2178485c5ba.
{
"llm_int8_has_fp16_weight": false,
"llm_int8_threshold": 6.0,
"load_in_8bit": true
}
Load with trust_remote_code=True, device_map="auto", and torch_dtype="auto".