Skip to content

Joseph717171

Hermes-3-Llama-3.2-3B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF

Joseph717171/Hermes-3-Llama-3.2-3B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF

Hermes-3-Llama-3.2-3B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF is a machine learning model from Joseph717171. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Custom GGUF quants of Hermes-3-Llama-3.2-3B, where the Output Tensors are quantized to Q80 or upcast to F32, while the Embeddings are kept at F32. Enjoy! 🧠🔥🚀

Downloads · 30 days

74

4% of all-time downloads

All-time downloads

2K

Public

Repo size

11.7 GB

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf23.5 GB · 100%

At a glance

Access
Public
Created
Dec 13, 2024
Updated
Dec 13, 2024
SHA
1988f06c
Created
Dec 13, 2024
Updated
Dec 13, 2024