Mew1-2.6B-GGUF

🐱 Mew1-2.6B-GGUF

Owner-maintained GGUF quantizations of Unmid/Mew1-2.6B, prepared for llama.cpp, LM Studio, and other GGUF-compatible applications.

The canonical BF16 Transformers checkpoint is available at Unmid/Mew1-2.6B. Additional importance-matrix quantizations are available from mradermacher.

Provided files

Files are sorted from smallest to largest. Sizes are the actual decimal file sizes reported by the Hugging Face Hub.

Download and run

Install the Hugging Face CLI and download the recommended quant:

pip install -U huggingface_hub
hf download Unmid/Mew1-2.6B-GGUF Mew1-2.6B.Q4_K_M.gguf --local-dir .

Run it with llama.cpp:

llama-cli \
  -m Mew1-2.6B.Q4_K_M.gguf \
  -c 4096 \
  --temp 0.7 \
  --top-k 50 \
  --top-p 0.9 \
  --repeat-penalty 1.1 \
  -cnv

The model metadata supports a context of approximately 128K tokens, but memory use grows with context length. Start with 4K–16K and increase only if your hardware allows it.

Quant selection

• Q4_K_M — recommended starting point for most users.
• Q5_K_M or Q6_K — use when quality matters more than memory.
• Q8_0 — largest quantized file; useful when memory is plentiful.
• Q2_K — only for severe memory constraints.

LEAP manifests

The leap/ directory contains one manifest per quantization. Each manifest references the corresponding root-level GGUF filename and uses the checkpoint chat template.

Model lineage

LiquidAI/LFM2.5-2.6B → SC117/LFM2.5-2.6B-Uncensored → Unmid/Mew1-2.6B → this GGUF release.

This is a community derivative and is not an official Liquid AI or SC117 release.

License

Distributed under the LFM Open License v1.0. Review LICENSE, including its attribution and commercial-use conditions.