Downloads · 30 days
34
23% of all-time downloads
Cannae-AI/TANIT-V0.6-12B-IT-gguf
TANIT-V0.6-12B-IT-gguf is a machine learning model from Cannae-AI. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: CannaeAI - License: apache-2.0 - quantized by : Cannae-AI - Base model : CannaeAI/TANIT-V0.6-12B-IT
Downloads · 30 days
34
23% of all-time downloads
All-time downloads
150
Public
Repo size
13.4 GB
Likes
0
Public
Click a slice to open those files.
.gguf13.4 GB · 100%
From the Hugging Face model README
TANIT-V0.6-12b-it.Q8_0.ggufTANIT-V0.6-12b-it.BF16-mmproj.ggufImportant: Ollama currently does not support separate mmproj files for vision models.
To create an Ollama model from this vision model:
Modelfile in the same directory as the finetuned bf16 merged modelollama create model_name -f ./Modelfile
(Replace model_name with your desired name)This will create a unified bf16 model that Ollama can use.
The model's BOS token behavior was adjusted for GGUF compatibility.