Downloads · 30 days
42
7% of all-time downloads
Cannae-AI/TANIT-V0.6-4B-IT-gguf
TANIT-V0.6-4B-IT-gguf is a image-text-to-text model from Cannae-AI. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: CannaeAI - License: apache-2.0 - quantized by : Cannae-AI - Base model : CannaeAI/TANIT-V0.6-4B-IT
Downloads · 30 days
42
7% of all-time downloads
All-time downloads
638
Public
Repo size
5 GB
Likes
0
Public
Click a slice to open those files.
.gguf5 GB · 100%
From the Hugging Face model README
TANIT-V0.6-4b-it.Q8_0.ggufTANIT-V0.6-4b-it.BF16-mmproj.ggufImportant: Ollama currently does not support separate mmproj files for vision models.
To create an Ollama model from this vision model:
Modelfile in the same directory as the finetuned bf16 merged modelollama create model_name -f ./Modelfile
(Replace model_name with your desired name)This will create a unified bf16 model that Ollama can use.
The model's BOS token behavior was adjusted for GGUF compatibility.