Skip to content

Joseph717171

Llama-3.2-3B-Instruct-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF

Joseph717171/Llama-3.2-3B-Instruct-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF

Llama-3.2-3B-Instruct-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF is a machine learning model from Joseph717171. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Custom GGUF quants of Meta’s Llama-3.2-3B-Instruct, where the Output Tensors are quantized to Q80 or kept at F32, and the Embeddings are kept at F32. Enjoy! 🧠🔥🚀

Downloads · 30 days

155

6% of all-time downloads

All-time downloads

2.6K

Public

Repo size

11.7 GB

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf23.5 GB · 100%

At a glance

Access
Public
Created
Sep 25, 2024
Updated
Sep 26, 2024
SHA
5c6d3c63
Created
Sep 25, 2024
Updated
Sep 26, 2024