LFM2.5-8B-A1B-Abliterated

LFM2.5-8B-A1B Abliterated

One repository for PocketAI Model Lab's validated MLX and GGUF releases. All variants derive from the same architecture-aware, reduced-refusal BF16 master based on LiquidAI/LFM2.5-8B-A1B.

Available variants

The root MLX configuration is the validated 4-bit model.

Validation

These are focused release gates, not broad benchmark scores or a guarantee of correctness on every task.

Artifact identities

MLX 4-bit usage

Install a current version of MLX-LM on an Apple Silicon Mac:

python -m pip install -U mlx-lm

from mlx_lm import generate, load

repo = "PocketAiHub/LFM2.5-8B-A1B-Abliterated"
model, tokenizer = load(repo)

messages = [{"role": "user", "content": "Explain why seasons occur."}]
prompt = tokenizer.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True,
)

print(
    generate(
        model,
        tokenizer,
        prompt=prompt,
        max_tokens=512,
        repetition_penalty=1.01,
        repetition_context_size=20,
    )
)

Most eligible weights use 4-bit affine quantization with group size 64. Sensitive output paths, the tied token embedding/output matrix, dense and MoE down projections, and layer 4 conv.in_proj retain 6-bit precision. MoE routers remain 8-bit. The validated greedy/repetition profile is encoded in generation_config.json.

GGUF usage

Use a current llama.cpp build with LFM2.5 support:

llama-cli \
  -m LFM2.5-8B-A1B-Abliterated-Q4_K_M.gguf \
  -ngl 99 \
  -cnv

Q4_K_M is the compact/default variant and was calibrated with an importance matrix collected from 512 direction-data prompts. Q6_K is the higher-quality variant. Suggested starting requirements are 9 GB RAM / 6 GB VRAM for Q4_K_M and 12 GB RAM / 8 GB VRAM for Q6_K, although actual use depends on context, KV-cache, batching, and offload settings.

Reduced-refusal parent

The BF16 parent used a projected refusal direction measured from 256 harmful and 256 harmless prompts. The edit targeted 528 output tensors across the hybrid attention, convolution, dense, and MoE expert architecture, using source layer 16, destination layers 8–23, scale 2.25, and per-input-column norm preservation.

This release is described as abliterated or reduced-refusal, not “fully uncensored.” Zero explicit refusals on a finite held-out suite cannot prove that every possible request will receive a substantive answer.

Risks and limitations

• Refusal suppression reduces built-in safety behavior and can make harmful, offensive, deceptive, or illegal-use assistance easier to elicit.
• Quantization can introduce quality changes not covered by the release suite.
• The model can hallucinate and should not be trusted for medical, legal, financial, security-critical, or other high-stakes decisions.
• Users and downstream applications are responsible for safeguards and compliance with applicable law and the model license.

License and attribution

This derivative is distributed under the LFM Open License v1.0, inherited from Liquid AI's original model. The license includes a commercial-use revenue limitation; review the complete terms before using or redistributing the model.

• Original model: https://huggingface.co/LiquidAI/LFM2.5-8B-A1B
• Model Lab source: https://github.com/PocketAIHub/pocketai-model-lab