pinkelephant-llm-48b-s-verification

Pink Elephant 48B-S — Verification

Industrial-standard, end-to-end verification of the FINAL aligned model. This repo is the single home for every tool, notebook, and recorded result used to verify the complete production model — not an intermediate stage.

pink-elephant-llm-14b (dense 14B)
    └─add weights / upcycle──▶ 48b-moe-base (8-expert MoE) ──train──▶ 48b
    └─remaining epochs──▶ 48b-s (flagship, s = smarter)
    └─+SFT best (step90000)──▶ +DPO best (dpo-best)──▶ FINAL MODEL  ⇐ verified here
    └─GGUF conversion──▶ run locally via Ollama / LM Studio

Pipeline stage index: base → moe → train → sft → dpo → verification (this) → release

After verification, the model is converted to GGUF for local use in Ollama / LM Studio.

---

Why a dedicated repo

Verification targets the whole final model (base 48B-S + SFT + DPO merged), which is the artifact users actually download and run. Keeping verification separate from the DPO training repo reflects that: the SFT/DPO repos are training stages; this repo is the acceptance gate for the finished model.

---

Tooling inventory

---

Quick start

CPU-only structural + weight checks (no GPU)

pip install -r requirements.txt   # torch optional for S1, needed for adapter inspection
python tooling/run_all.py --structural \
    --sft /path/sft-lora-step90000.pt --dpo /path/dpo-best.pt \
    --json results/

Full GPU verification (Blackwell, ~96 GB, bf16)

# On the verification host:
python tooling/adapter_to_peft.py sft-lora-step90000.pt peft/sft
python tooling/adapter_to_peft.py dpo-best.pt           peft/dpo
python tooling/run_benchmarks.py            # GSM8K + MMLU (S3–S6)
# or run notebooks/verify_full_model.py (single notebook, all of S1–S6)

---

Recorded results (this build)

Populated from live verification runs on our Blackwell host. See results/ JSON files.

---

Results gallery

---

GPU / environment

• Requires a Blackwell GPU host (~96 GB), runs in bf16.
• Model load ≈ 3 min, held in kernel memory across notebook cells (kernel-global persistence).
• Base: pinkelephantlimited/pinkelephant-llm-48b-s. Adapters: pinkelephantlimited/pinkelephant-llm-48b-s-dpo (sft/sft-lora-step90000.pt, dpo/dpo-best.pt).

---

License

MIT — Pink Elephant Limited.