qwen2.5-0.5b-gguf

qwen2.5-0.5b-gguf (Enclave model volume)

Curated model volume for Enclave confidential inference: Qwen2.5-0.5B-Instruct at q4_k_m, bundled with its tokenizer.json so the volume is self-contained. The upstream GGUF repo ships no tokenizer file, and Enclave's llm-chat app tokenizes in-guest with the HF tokenizers crate, which needs tokenizer.json alongside the weights.

Both files are unmodified byte-for-byte copies of their pinned upstream sources — this repo only co-locates them.

Provenance

LICENSE is the Apache-2.0 text as shipped by the upstream GGUF repo at the same pinned revision.

Usage on Enclave

Wrapped as a Tinfoil Modelwrap volume (dm-verity; the root hash is part of the enclave measurement). Deployments attach it by name and the guest reads it at /models/<name>; the host preloads the GGUF as the wasi-nn ggml graph. With the tokenizer bundled, llm-chat's default tokenizer.json lookup works with no cross-volume configuration.