Downloads · 30 days
31
3% of all-time downloads
NexesQuants/Meta-Llama-3.1-70b-instruct-bf16-iMat-CQ-GGUF
Meta-Llama-3.1-70b-instruct-bf16-iMat-CQ-GGUF is a machine learning model from NexesQuants. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.1.
IQ5K quant requires IKLlama.CPP or Croco.Cpp to run.
Downloads · 30 days
31
3% of all-time downloads
All-time downloads
1.2K
Public
Repo size
273 GB
Likes
0
Public
Click a slice to open those files.
.gguf273 GB · 100%
From the Hugging Face model README
IQ5_K quant requires IK_Llama.CPP or Croco.Cpp to run.