Zeroth42-4B

Zeroth42-4B

Safety-Certified Linux Installer Co-Pilot — a 4B assistant that guides non-technical users through installing a Void Linux-based OS (#42 OS), with a guardrail that validates every recommendation before it reaches the disk.

Brand: Zeroth42 (Asimov's Zeroth Law — safety as an unbreakable law of the system). Repos: FLvdwl/Zeroth42-4B (ModelScope), FLvdW/Zeroth42-4B (HF).

Files

Key results (honest, re-measured on a fixed served path, 2026-08-28)

N=3 samples per question, temperature 0.2, two independent runs — both scored 44.0 (identical scores across runs). The fine-tuned model is +10.5 better than base on the installer register — an earlier eval was inverted by a chat-template bug; we found it (four-way model consultation), fixed it, and publish the corrected numbers openly.

Serve

llama-server -m Zeroth42-4B-Q4_K_M.gguf -c 8192 -ngl 99

The training-format chat template is embedded in the GGUF — no serve flags needed. CPU-only works (~3.7 s/question). Full details in MODEL_CARD.md.

Scope: the certified system is the co-pilot — this GGUF behind the guardrail (scripts/rules.json). Served standalone, it answers installer questions only; it cannot see your system, and out-of-scope questions (e.g. "which media player is installed?") may be answered confidently but wrongly.

---

中文摘要

Zeroth42-4B：过了安全认证的 Linux 安装助手（基于 Qwen3.8-4B-Distilled，Apache-2.0）

• 4B 模型，带着不熟 Linux 的人把系统装完
• 训练和推理全部在二手 AMD 上完成（MI50 32GB + RX 9060 XT 16GB，一共大约 1500 美元），不用 CUDA
• 安装问答 44.0/69，比底模高 10.5 分；安全审计 29/29；护栏 8/11 通过（2 次宁可误拦，1 次自相矛盾被拦住）
• 护栏是 Calamares 模块：模型的建议先校验，通过了才允许写进安装器。过不了的，到不了磁盘
• 没显卡也能跑，每题大约 3.7 秒，预算紧的也能用
• 给谁用：想离开 Windows 或主流发行版的人。烦广告、烦遥测、不想自己当产品。中国是很大一块，同样的需求别处也有。模型按 Apache-2.0 开源，先把社区信任做起来；真正作为产品卖的是 #42 OS（系统里内置这个助手）

使用范围： 这个模型只回答安装问题，并且要在护栏后面用。单独跑它时，它看不到你的系统——超出安装范围的问题（比如“我机器上装了哪个播放器？”）可能会自信地答错。带护栏的完整安装助手才是通过认证的产品。

评测说明： 聊天模板有过一个 bug，把底模分数抬高了。修完重测，对比反过来——微调模型其实一直比底模高 10.5 分。bug、修复过程、正确数字都公开。

路线图： v1.1（2026 年 9 月底）：#42 OS 安装器实机演示视频；v2：混合语料训练，修复自我矛盾问题。

---

Runs on llama.cpp/GGUF (community stack; we operate it). Hardware anyone can buy used.