GPUburnout-3B-75K-Chat-v2

GPUburnout-3B-75K-Chat-v2

3B parameter Llama-style chat model trained from scratch by Jun Park (GPUburnout).

This is v2 of the 3B-Chat. The original GPUburnout-3B-75K-Chat was trained with a plain-concat SFT data formatter instead of the proper apply_chat_template flow. That bug caused loop collapse at inference and made the 3B underperform the 2B on ARC-Easy by 8 points.

v2 is the same base pretraining (GPUburnout-3B-75K) with the correct chat-template SFT recipe applied (Run A from the recipe-parity ablation: lr=2e-4 + apply_chat_template). It wins on 5 of 6 benchmarks vs the 2B chat model.

Full backstory: It Took Me Two Weeks to Read My Own Code

Benchmarks

(The v1 +25.18 IFEval is a format-mismatch artifact. The honest v2 number is -3.36 vs base, consistent with the linear trend across 1B and 2B.)

Files

• model.safetensors and tokenizer files: full-precision HF format
• GPUburnout-3B-75K-Chat-v2-f16.gguf: GGUF f16 for llama.cpp
• GPUburnout-3B-75K-Chat-v2-Q4_K_M.gguf: Q4_K_M quantized GGUF (~1.9 GB, recommended for CPU inference)

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("GPUburnout/GPUburnout-3B-75K-Chat-v2")
model = AutoModelForCausalLM.from_pretrained("GPUburnout/GPUburnout-3B-75K-Chat-v2")

Or via llama.cpp / llama-cpp-python with the Q4_K_M GGUF.