qwen2.5-0.5b-instruct-q4f16

Qwen2.5-0.5B-Instruct (q4f16_1, WebLLM)

Browser-ready mlc artifacts for text-generation, produced by SkillSafe's reproducible converter (models/ in skillsafe.ai) from a pinned upstream source. Every byte here is derivable from that source plus the recipe below; nothing was edited by hand.

Provenance

Files

registry files are parameter files served from models.skillsafe.ai once vetted; bundle files ship inside an app; registry-shared is a runtime library reused by every model of the same architecture.

Verification

Shard sizes and md5s match ndarray-cache.json; the implied parameter count matches the checkpoint (494,032,768 parameters, 4.50 bits/param); the parameter table embedded in the WebGPU model library matches all 267 tensors of these weights.

Use in the browser (WebLLM)

import { CreateMLCEngine } from "@mlc-ai/web-llm";
const engine = await CreateMLCEngine("qwen2.5-0.5b-instruct-q4f16", {
  appConfig: { model_list: [{
    model: "https://huggingface.co/skillsafe-ai/qwen2.5-0.5b-instruct-q4f16",
    model_id: "qwen2.5-0.5b-instruct-q4f16",
    model_lib: "https://huggingface.co/skillsafe-ai/qwen2.5-0.5b-instruct-q4f16/resolve/main/lib/Qwen2-0.5B-Instruct-q4f16_1-ctx4k_cs1k-webgpu.wasm",
    overrides: { context_window_size: 4096, prefill_chunk_size: 1024 },
  }] },
});

The model library is compiled for context window 4096 / prefill chunk 1024; mlc-chat-config.json says 32768 / 2048, so set the overrides above.

Licence and attribution

Qwen2.5-0.5B-Instruct: Copyright 2024 Alibaba Cloud. Apache License 2.0. https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct — q4f16_1 weights published by MLC (https://huggingface.co/mlc-ai/Qwen2.5-0.5B-Instruct-q4f16_1-MLC).

Licence: Apache-2.0 — notice: https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct/blob/7ae557604adf67be50417f59c2c2f167def9a775/LICENSE. The conversion recipe and this model card are part of the SkillSafe repository and carry its licence; the weights remain under the upstream licence above.

The full manifest.json in this repo records the recipe, sources, toolchain (including the uv.lock hash) and per-file verification numbers.