MIXdevAI-qwen-GGUF

kirilldual0987/MIXdevAI-qwen-GGUF

MIXdevAI-qwen-GGUF is a text generation model from kirilldual0987. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.

Full set of GGUF quantizations for Kolyadual/MIXdevAI-qwen.

Downloads · 30 days

348

22% of all-time downloads

All-time downloads

1.6K

Public

Repo size

44.9 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf44.9 GB · 100%

At a glance

Task: Text Generation
License: apache-2.0
Access: Public
Created: Jul 4, 2026
Updated: Jul 4, 2026
SHA: 27323315

Try a prompt

Base models

Kolyadual/MIXdevAI-qwen

Model card

From the Hugging Face model README

MIXdevAI-qwen-GGUF

Full set of GGUF quantizations for Kolyadual/MIXdevAI-qwen.

Based on the Qwen3 architecture (Qwen3ForCausalLM) with 36 layers, 262K context length, and 2560 embedding dimension.

Files

File	Quantization	Type
`mixdev-qwen-f16.gguf`	F16	Base Model
`mixdev-qwen-q8_0.gguf`	Q8_0	Text Model
`mixdev-qwen-q6_k.gguf`	Q6_K	Text Model
`mixdev-qwen-q5_k_m.gguf`	Q5_K_M	Text Model
`mixdev-qwen-q5_k_s.gguf`	Q5_K_S	Text Model
`mixdev-qwen-q5_1.gguf`	Q5_1	Text Model
`mixdev-qwen-q5_0.gguf`	Q5_0	Text Model
`mixdev-qwen-q4_k_m.gguf`	Q4_K_M	Text Model
`mixdev-qwen-q4_k_s.gguf`	Q4_K_S	Text Model
`mixdev-qwen-q4_1.gguf`	Q4_1	Text Model
`mixdev-qwen-q4_0.gguf`	Q4_0	Text Model
`mixdev-qwen-q3_k_l.gguf`	Q3_K_L	Text Model
`mixdev-qwen-q3_k_m.gguf`	Q3_K_M	Text Model
`mixdev-qwen-q3_k_s.gguf`	Q3_K_S	Text Model
`mixdev-qwen-q2_k.gguf`	Q2_K	Text Model

Quantization notes

Q8_0 / F16: Almost lossless. Best quality, largest size.
Q6_K / Q5_K_M: Excellent balance between quality and size.
Q4_K_M: Golden standard for local inference.
Q3_K_M / Q2_K: Noticeable quality degradation. Use only if you have severe RAM/VRAM constraints.

How to run locally

Example using llama.cpp server:

llama-server \
  -m mixdev-qwen-q4_k_m.gguf \
  -ngl 999 \
  --host 0.0.0.0 --port 8080 \
  -c 32768

Task: Text Generation
License: apache-2.0
Created: Jul 4, 2026
Updated: Jul 4, 2026