OpenElla3-Llama3.2-GGUF

N-Bot-Int/OpenElla3-Llama3.2-GGUF

OpenElla3-Llama3.2-GGUF is a text generation model from N-Bot-Int. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

- [](https://ko-fi.com/J3J61D8NHV) - https://ko-fi.com/nexusnetworkint

Downloads · 30 days

6% of all-time downloads

All-time downloads

707

Public

Repo size

6.8 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf3.4 GB · 100%

At a glance

Task: Text Generation
Library: transformers
License: apache-2.0
Model type: llama
Access: Public
Created: Mar 12, 2025
Updated: Apr 15, 2025
SHA: c9809e06

Try a prompt

Base models

N-Bot-Int/OpenElla3-Llama3.2B

Datasets

Model card

From the Hugging Face model README

Support Us Through

[https://ko-fi.com/nexusnetworkint](Official Ko-FI link!)

GGUF Version

GGUF with Quants! Allowing you to run models using KoboldCPP and other AI Environments!

Quantizations:

Quant Type	Benefits	Cons
Q4_K_M	✅ Smallest size (fastest inference)	❌ Lowest accuracy compared to other quants
	✅ Requires the least VRAM/RAM	❌ May struggle with complex reasoning
	✅ Ideal for edge devices & low-resource setups	❌ Can produce slightly degraded text quality
Q5_K_M	✅ Better accuracy than Q4, while still compact	❌ Slightly larger model size than Q4
	✅ Good balance between speed and precision	❌ Needs a bit more VRAM than Q4
	✅ Works well on mid-range GPUs	❌ Still not as accurate as higher-bit models
Q8_0	✅ Highest accuracy (closest to full model)	❌ Requires significantly more VRAM/RAM
	✅ Best for complex reasoning & detailed outputs	❌ Slower inference compared to Q4 & Q5
	✅ Suitable for high-end GPUs & serious workloads	❌ Larger file size (takes more storage)

Model Details:

Read the Model details on huggingface

Task: Text Generation
Library: transformers
Type: llama
License: apache-2.0
Languages: en
Created: Mar 12, 2025
Updated: Apr 15, 2025