Downloads · 30 days
26
8% of all-time downloads
Manel/Mistral-NeMo-Minitron-8B-Instruct-Q2_K-GGUF
Mistral-NeMo-Minitron-8B-Instruct-Q2_K-GGUF is a text generation model from Manel. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This is a converted model to GGUF from nvidia/Mistral-NeMo-Minitron-8B-Instruct quantized to Q2K using llama.cpp library.
Downloads · 30 days
26
8% of all-time downloads
All-time downloads
317
Public
Repo size
3.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf3.3 GB · 100%
From the Hugging Face model README
This is a converted model to GGUF from nvidia/Mistral-NeMo-Minitron-8B-Instruct quantized to Q2_K using llama.cpp library.