quem-V2-4b-GGUF

rodrigomt/quem-V2-4b-GGUF

quem-V2-4b-GGUF is a text generation model from rodrigomt. Use it when you need the model to write or continue text.

Quantized version of: rodrigomt/quem-V2-4b

Downloads · 30 days

6% of all-time downloads

All-time downloads

483

Public

Repo size

17.2 GB

Likes

Public

Repo makeup

Click a slice to open those files.

.gguf17.2 GB · 100%

From the Hugging Face model README

Quantized version of: rodrigomt/quem-V2-4b

Format	Description
F16	Full precision (16-bit), better quality, larger size ⚖️
Q8_K_XL	Quantized (8-bit XL variant, based on the quantization table of the unsloth model Qwen3-4B-Thinking-2507), smaller size, faster inference ⚡
Q4_K_XL	Quantized (4-bit XL variant, based on the quantization table of the unsloth model Qwen3-4B-Thinking-2507), smaller size, faster inference ⚡

Example with llama.cpp:

./main -m ./gguf-file-name.gguf -p "Hello world!"