MIXdevAI-yandexGPT5-8B-GGUF

kirilldual0987/MIXdevAI-yandexGPT5-8B-GGUF

MIXdevAI-yandexGPT5-8B-GGUF is a text generation model from kirilldual0987. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.

Full set of GGUF quantizations for Kolyadual/MIXdevAI-yandexGPT5-8B.

Downloads · 30 days

486

21% of all-time downloads

All-time downloads

2.4K

Public

Repo size

88.8 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf88.8 GB · 100%

At a glance

Task: Text Generation
License: apache-2.0
Access: Public
Created: Jul 4, 2026
Updated: Jul 4, 2026
SHA: 6fe070e0

Try a prompt

Base models

Kolyadual/MIXdevAI-yandexGPT5-8B

Model card

From the Hugging Face model README

MIXdevAI-yandexGPT5-8B-GGUF

Full set of GGUF quantizations for Kolyadual/MIXdevAI-yandexGPT5-8B.

Files

File	Quantization	Type
`mixdev-ya-f16.gguf`	F16	Base Model
`mixdev-ya-q8_0.gguf`	Q8_0	Text Model
`mixdev-ya-q6_k.gguf`	Q6_K	Text Model
`mixdev-ya-q5_k_m.gguf`	Q5_K_M	Text Model
`mixdev-ya-q5_k_s.gguf`	Q5_K_S	Text Model
`mixdev-ya-q5_1.gguf`	Q5_1	Text Model
`mixdev-ya-q5_0.gguf`	Q5_0	Text Model
`mixdev-ya-q4_k_m.gguf`	Q4_K_M	Text Model
`mixdev-ya-q4_k_s.gguf`	Q4_K_S	Text Model
`mixdev-ya-q4_1.gguf`	Q4_1	Text Model
`mixdev-ya-q4_0.gguf`	Q4_0	Text Model
`mixdev-ya-q3_k_l.gguf`	Q3_K_L	Text Model
`mixdev-ya-q3_k_m.gguf`	Q3_K_M	Text Model
`mixdev-ya-q3_k_s.gguf`	Q3_K_S	Text Model
`mixdev-ya-q2_k.gguf`	Q2_K	Text Model

Quantization notes

Q8_0 / F16: Almost lossless. Best quality, largest size.
Q6_K / Q5_K_M: Excellent balance between quality and size.
Q4_K_M: Golden standard for local inference.
Q3_K_M / Q2_K: Noticeable quality degradation. Use only if you have severe RAM/VRAM constraints.

How to run locally

Example using llama.cpp server:

llama-server \
  -m mixdev-ya-q4_k_m.gguf \
  -ngl 999 \
  --host 0.0.0.0 --port 8080 \
  -c 32768

Task: Text Generation
License: apache-2.0
Created: Jul 4, 2026
Updated: Jul 4, 2026