Skip to content

Joseph717171

Mistral-Nemo-12B-Instruct-2407-OQ8_0.EF32.IQ4_K-Q8_0-GGUF

Joseph717171/Mistral-Nemo-12B-Instruct-2407-OQ8_0.EF32.IQ4_K-Q8_0-GGUF

Mistral-Nemo-12B-Instruct-2407-OQ8_0.EF32.IQ4_K-Q8_0-GGUF is a machine learning model from Joseph717171. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Custom GGUF quants of Mistral-Nemo-Instruct-2407, where the Output Tensors are quantized to Q80 while the Embeddings are kept at F32. 🧠🔥🚀

Downloads · 30 days

91

3% of all-time downloads

All-time downloads

2.7K

Public

Repo size

37.3 GB

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf37.3 GB · 100%

At a glance

Access
Public
Created
Sep 10, 2024
Updated
Sep 10, 2024
SHA
34ec0683
Created
Sep 10, 2024
Updated
Sep 10, 2024