Mew1-2.6B

🐱 Mew1-2.6B

Mew1-2.6B is a 2.69B-parameter LFM2-family text-generation model released by Unmid. This is the canonical BF16 Transformers checkpoint; ready-to-run GGUF files are published separately in Unmid/Mew1-2.6B-GGUF.

Model details

The checkpoint is intended for local conversational generation, creative writing, roleplay, instruction following, and experimentation on resource-constrained hardware. A complete reproducibility report and independent benchmark suite for the Mew1 modification have not yet been published; performance claims should be evaluated on your own workloads.

Files in this repository

The four model-0000x-of-00004.safetensors files are the actual BF16 model weights. model.safetensors.index.json maps every tensor to its shard. These are standard Transformers files and should be kept together.

Usage with Transformers

LFM2 is supported natively by recent Transformers releases. No custom remote code is required.

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "Unmid/Mew1-2.6B"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    dtype=torch.bfloat16,
    device_map="auto",
)

messages = [
    {"role": "system", "content": "You are a helpful assistant."},
    {"role": "user", "content": "Write a short story about a cat exploring the Moon."},
]

input_ids = tokenizer.apply_chat_template(
    messages,
    add_generation_prompt=True,
    return_tensors="pt",
).to(model.device)

output = model.generate(
    input_ids,
    max_new_tokens=512,
    do_sample=True,
    temperature=0.7,
    top_k=50,
    top_p=0.9,
    repetition_penalty=1.1,
)

print(tokenizer.decode(output[0, input_ids.shape[-1]:], skip_special_tokens=True))

GGUF downloads

The owner-maintained GGUF release is Unmid/Mew1-2.6B-GGUF.

For backward compatibility, the earlier GGUF copies under this repository's ggufs/ directory remain available. No model artifacts were removed during the reorganization.

Additional community quantizations are available from mradermacher:

Limitations and responsible use

Mew1 may produce incorrect, biased, unsafe, or fabricated text. “Uncensored” describes reduced refusal behavior; it does not guarantee accuracy or suitability. Validate outputs before relying on them, especially for medical, legal, financial, security, or other high-impact decisions. Users are responsible for complying with applicable law and the model license.

License and attribution

This derivative is distributed under the LFM Open License v1.0. Review LICENSE, including its attribution and commercial-use conditions. Mew1 builds on work by Liquid AI and SC117; quantized community releases should also credit their respective quantizers.