Downloads · 30 days
6
10% of all-time downloads
ohjoonhee/vlatents-qwen25vl7b-stage3-upstream-ep3-v1
vlatents-qwen25vl7b-stage3-upstream-ep3-v1 is a image-text-to-text model from ohjoonhee. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
One-line identity: Stage 1 NTP SFT fine-tune of Qwen/Qwen2.5-VL-7B-Instruct on the ohjoonhee/visual-cot-50k-poc dataset (Monet-SFT-125K VisualCoT subset). Trains the model to emit <observation and other Monet special…
Downloads · 30 days
6
10% of all-time downloads
All-time downloads
61
Public
Parameters
8.3B
33.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.6 GB · 100%
From the Hugging Face model README
One-line identity: Stage 1 NTP SFT fine-tune of Qwen/Qwen2.5-VL-7B-Instruct on the ohjoonhee/visual-cot-50k-poc dataset (Monet-SFT-125K Visual_CoT subset). Trains the model to emit <observation> and other Monet special tokens fluently before Stage 2's alignment objective layers in latent slots. Baseline reference for downstream Stage 2 / Pivot A runs.
Qwen/Qwen2.5-VL-7B-Instruct(none)ohjoonhee/visual-cot-50k-poc (Monet-SFT-125K Visual_CoT subset, eval-200 excluded)Pure NTP SFT — no Monet Stage 2 alignment loss, no latent-mode forward.
The Monet special tokens (<observation>, <abs_vis_token>, etc.) ARE
registered in the tokenizer and embedded so the model learns to produce
them, but the architectural latent-slot mechanism is unused at this stage.
step-2913)No training log row available.
Faithful epochs=3 upstream Monet Stage 3 (released recipe). 2-job resume (218542+218752), full 3 epochs / step 2913. Init Monet-SFT-7B/stage1, teacher upstream-precomputed 124K latents. Final train align_loss 0.026, obs_acc 0.99.
Other revisions: see the revisions dropdown on this page.
from transformers import AutoModelForVision2Seq, AutoProcessor
m = AutoModelForVision2Seq.from_pretrained(
"ohjoonhee/vlatents-qwen25vl7b-stage3-upstream-ep3-v1", revision="step-2913", torch_dtype="bfloat16")
p = AutoProcessor.from_pretrained("ohjoonhee/vlatents-qwen25vl7b-stage3-upstream-ep3-v1", revision="step-2913")
Research checkpoint, eval-only. Mid-training step (2913/?). Not for production.
Card generated 2026-06-04 from training_log.jsonl + the run's training config.