Skip to content

Joseph717171

Gemma-2-2b-it-OQ8_0-F32.EF32.IQ4_K_M-8_0-GGUF

Joseph717171/Gemma-2-2b-it-OQ8_0-F32.EF32.IQ4_K_M-8_0-GGUF

Gemma-2-2b-it-OQ8_0-F32.EF32.IQ4_K_M-8_0-GGUF is a machine learning model from Joseph717171. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Custom GGUF quants of Google’s gemma-2-2b-it, where the Output Tensors are quantized to Q80 or kept at F32 while the Embeddings are kept at F32. 🧠🔥🚀

Downloads · 30 days

103

6% of all-time downloads

All-time downloads

1.8K

Public

Repo size

19.1 GB

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf19.1 GB · 100%

At a glance

Access
Public
Created
Sep 14, 2024
Updated
Sep 23, 2024
SHA
4baaecb9
Created
Sep 14, 2024
Updated
Sep 23, 2024