Downloads · 30 days
7
8% of all-time downloads
RobustRDP-Pretrain-SFT
Jingcz/RobustRDP-Pretrain-SFT
RobustRDP-Pretrain-SFT is a image-text-to-text model from Jingcz. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as other.
Fine-tuned model for the paper: RobustRDP: Advancing Reaction Diagram Parsing via Synthetic-to-Real Data Scaling and Robustness-Oriented Training.
All-time downloads
87
Public
Parameters
4.1B
8.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8.1 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- Library
- transformers
- License
- other
- Model type
- qwen2_5_vl
- Access
- Public
- Created
- Jun 28, 2026
- Updated
- Jun 28, 2026
- SHA
- 18629503
Try a prompt
Base models
Model card
From the Hugging Face model README
RobustRDP-Pretrain-SFT
Fine-tuned model for the paper: RobustRDP: Advancing Reaction Diagram Parsing via Synthetic-to-Real Data Scaling and Robustness-Oriented Training.
Description
This model is a fine-tuned checkpoint based on Qwen2.5-VL-3B-Instruct, trained with a two-stage pipeline:
- Pretrain stage: Synthetic data pretraining on large-scale synthetic reaction diagrams.
- SFT stage: Supervised fine-tuning with three specialized tasks:
- Vanilla Reaction Parsing (VRP): Standard reaction diagram parsing
- Region-Guided Reaction Parsing (RGRP): Region-aware parsing with spatial guidance
- Prefix-Perturbed Reaction Parsing (PPRP): Robustness-oriented parsing with prefix perturbations
Training Details
| Config | Pretrain | SFT |
|---|---|---|
| Base Model | Qwen2.5-VL-3B-Instruct | Qwen2.5-VL-3B-Instruct |
| Learning Rate | 1.0×10⁻⁶ | 1.0×10⁻⁵ |
| Batch Size | 16 | 4 |
| Epochs | 1 | 1 |
| Scheduler | Cosine (warmup 0.03) | Cosine (warmup 0.03) |
| Optimizer | AdamW | AdamW |
| Trainable Params | LLM only | Full (vision + LLM) |
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "Jingcz/RobustRDP-Pretrain-SFT"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name)
Related Resources
- Dataset: RxnLabelData
- Annotation Platform: RxnLabel
- Task
- Image-Text-to-Text
- Library
- transformers
- Type
- qwen2_5_vl
- License
- other
- Created
- Jun 28, 2026
- Updated
- Jun 28, 2026