Qwen3-VL-OFT-LIBERO-4in1

Qwen3-VL OFT for LIBERO 4-in-1

This repository contains a StarVLA QwenOFT checkpoint initialized from Qwen3-VL-4B-Instruct and trained on the combined LIBERO libero_10 + libero_goal + libero_object + libero_spatial mixture. QwenOFT uses action placeholder tokens in the VLM sequence and an MLP/L1 regression head to predict a continuous action chunk.

Model and action contract

The compact saved config does not record an explicit camera list, image resolution, or normalization mode. The checkpoint-era QwenOFT path does not feed a numeric state vector to the MLP head; later code can optionally serialize state into the instruction, which is a different prompt contract. Keep dataset_statistics.json beside the checkpoint and verify the remaining inputs in the evaluator before comparing results.

Training recipe

LIBERO evaluation

The following success rates are retained from the original Hub Card.

Only the 50k weight is released. The repository does not include the raw per-episode evaluation logs, so the table is a reported result rather than a result independently reconstructable from this Hub repository.

Download and evaluation

huggingface-cli download StarVLA/Qwen3-VL-OFT-LIBERO-4in1 \
  --local-dir Qwen3-VL-OFT-LIBERO-4in1

CKPT="$PWD/Qwen3-VL-OFT-LIBERO-4in1/checkpoints/steps_50000_pytorch_model.pt"
python deployment/model_server/server_policy.py \
  --ckpt_path "$CKPT" --port 6694 --use_bf16 \
  --config_override framework.qwenvl.base_vlm=Qwen/Qwen3-VL-4B-Instruct

Use the separate LIBERO environment and evaluator documented in StarVLA's LIBERO guide.

Evidence and limitations

• Model structure and training settings were checked against config.yaml; the released step was checked against the Hub file tree.
• The saved base_vlm and dataset paths are environment-local and must be mapped to public/local equivalents.
• Changing normalization, camera order, state inclusion, action convention, or execution horizon can materially change success rates.
• Results are limited to LIBERO simulation. No real-robot or cross-embodiment validation is included.
• This is not a standalone Transformers from_pretrained() directory.