Downloads · 30 days
807
12% of all-time downloads
MarsupialAI/Llama-3.1-Nemotron-70B-Instruct_iMat_GGUF
Llama-3.1-Nemotron-70B-Instruct_iMat_GGUF is a text generation model from MarsupialAI. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.1.
iMatrix GGUFs for https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
Downloads · 30 days
807
12% of all-time downloads
All-time downloads
6.5K
Public
Repo size
595 GB
Likes
2
Public
Click a slice to open those files.
.gguf595 GB · 100%
From the Hugging Face model README
iMatrix GGUFs for https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
iMat generated using Kalomaze's groups_merged.txt