Skip to content

Joseph717171

Llama-3.2-1B-Instruct-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF

Joseph717171/Llama-3.2-1B-Instruct-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF

Llama-3.2-1B-Instruct-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF is a machine learning model from Joseph717171. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Custom GGUF quants of Meta’s Llama-3.2-1B-Instruct, where the Output Tensors are quantized to Q80 or kept at F32, and the Embeddings are kept at F32. Enjoy! 🧠🔥🚀

Downloads · 30 days

261

6% of all-time downloads

All-time downloads

4.3K

Public

Repo size

12.9 GB

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf14.7 GB · 100%

At a glance

Access
Public
Created
Sep 26, 2024
Updated
Mar 6, 2025
SHA
e91e9f73
Created
Sep 26, 2024
Updated
Mar 6, 2025