LFM2.5-1.2B-Instruct-q4f16_1-MLC

LFM2.5-1.2B-Instruct-q4f16_1-MLC

LiquidAI/LFM2.5-1.2B-Instruct (Liquid AI), compiled to MLC / WebGPU (q4f16_1) for in-tab / on-device inference via WebLLM. Ported with Kiln, which adds the LFM2 hybrid architecture (LIV short-conv + GQA/QK-norm) to mlc-llm — notably without any custom TVM operator (the conv-state rides an RNNState ring buffer alongside the KV cache).

• Quantization: q4f16_1 (~0.61 GB) · Context: 4096 · Decode: ~238 tok/s on an M4 Pro (Metal).
• Files: q4f16_1 weight shards + mlc-chat-config.json + tokenizer + LFM2.5-1.2B-Instruct-q4f16_1-webgpu.wasm (WebGPU model lib).

Use (WebLLM)

import { CreateMLCEngine } from "@mlc-ai/web-llm";
const appConfig = { model_list: [{
  model: "https://huggingface.co/naklitechie/LFM2.5-1.2B-Instruct-q4f16_1-MLC/resolve/main/",
  model_id: "LFM2.5-1.2B-Instruct-q4f16_1-MLC",
  model_lib: "https://huggingface.co/naklitechie/LFM2.5-1.2B-Instruct-q4f16_1-MLC/resolve/main/LFM2.5-1.2B-Instruct-q4f16_1-webgpu.wasm",
  overrides: { context_window_size: 4096 },
}]};
const engine = await CreateMLCEngine("LFM2.5-1.2B-Instruct-q4f16_1-MLC", { appConfig });

⚠️ Runtime match. Compiled with mlc-llm main (TVM 0.25.dev0); the cache manifest is tensor-cache.json. Load with a @mlc-ai/web-llm build whose bundled tvmjs matches — stock 0.2.84 expects an older runtime + ndarray-cache.json and will not load this as-is.

Attribution & license

Format conversion only. The original model and its LFM Open License are © Liquid AI (LiquidAI/LFM2.5-1.2B-Instruct). MLC compilation: Kiln · NakliTechie/mlc-llm.