Downloads · 30 days
9
2% of all-time downloads
k2-v2-think-dpo-checkpoint-200
sambal/k2-v2-think-dpo-checkpoint-200
k2-v2-think-dpo-checkpoint-200 is a text generation model from sambal. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This repository contains the merged BF16 Hugging Face checkpoint from iteration 200 of a 496-iteration, four-node DPO run.
All-time downloads
519
Public
Parameters
32.8B
65.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors65.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Sep 2, 2026
- Updated
- Sep 2, 2026
- SHA
- 1a69169d
Try a prompt
Base models
Model card
From the Hugging Face model README
K2-v2-Think DPO - checkpoint 200
This repository contains the merged BF16 Hugging Face checkpoint from iteration 200 of a 496-iteration, four-node DPO run.
Details
- Base model:
LLM360/K2-Think - Architecture:
Qwen2ForCausalLM(32B class) - Training objective: sigmoid DPO (
beta=0.1) with RPO (alpha=0.1) - Chat template: K2 v2 high, included as
chat_template.jinja - Format: merged Transformers checkpoint, 14 BF16 safetensors shards
- Training state: intermediate checkpoint at iteration 200/496
Loading
from transformers import AutoModelForCausalLM, AutoTokenizer
repo_id = "sambal/k2-v2-think-dpo-checkpoint-200"
tokenizer = AutoTokenizer.from_pretrained(repo_id)
model = AutoModelForCausalLM.from_pretrained(
repo_id,
torch_dtype="auto",
device_map="auto",
)
This is an intermediate preference-training checkpoint. Evaluate it on the intended downstream tasks before deployment.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Created
- Sep 2, 2026
- Updated
- Sep 2, 2026