Downloads · 30 days
4
27% of all-time downloads
Hoshipu/xvla-v20-task0-mp-radio-lr1e4-rw
xvla-v20-task0-mp-radio-lr1e4-rw is a robotics model from Hoshipu. Use it for the robotics task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
Fine-tune of 2toINF/X-VLA-Pt on a single BEHAVIOR-1K task (turning on the radio receiver), using the v20 architecture from markli1hoshipu/behavior1k-xvla @ v20.
Downloads · 30 days
4
27% of all-time downloads
All-time downloads
15
Public
Repo size
3.5 GB
Likes
0
Public
Click a slice to open those files.
.safetensors3.5 GB · 100%
From the Hugging Face model README
Fine-tune of 2toINF/X-VLA-Pt on a single BEHAVIOR-1K task (turning on the radio receiver), using the v20 architecture from markli1hoshipu/behavior1k-xvla @ v20.
Hoshipu/xvla-v20-task0-mp-radioThe earlier model used the global 50-task SKILL_CLASS_WEIGHTS (sqrt-inverse-frequency across all 34 BEHAVIOR-1K skills). For this single-task dataset the distribution is very different, and the global weights silently suppressed the pick up from skill prediction at inference: gradients pulled the classifier toward press (global weight 2.26) far harder than toward pick up from (global weight 0.10), even though "pick up from" is 35.9% of frames in radio data.
Fix: recomputed the weights from this dataset's actual 4-skill distribution.
| Skill | global weight (old) | task-0 weight (new) | Δ |
|---|---|---|---|
| move to | 0.086 | 0.538 | 6× |
| pick up from | 0.102 | 0.601 | 6× |
| place on | 0.214 | 1.957 | 9× |
| press | 2.256 | 0.904 | 0.4× |
Recipe: behavior1k_training/compute_skill_weights.py (added in v20) — generates a JSON consumable via continue_train.py --skill_weights_json ….
| Setting | Value |
|---|---|
| Base model | 2toINF/X-VLA-Pt |
| Dataset | Hoshipu/behavior-1k-mp-collected-turning-on-radio (success, task 0) |
| Trainable episodes | 1354 |
| Total frames | 2,845,413 |
| GPUs | 4 × NVIDIA H200 |
| Per-GPU batch | 32 |
| Effective batch | 128 |
| Precision | bf16 |
| LR (core) | 1e-4, cosine decay to 1e-5 |
| LR (VLM, soft prompts) | 0.1 × LR |
| Warmup | 2000 steps |
| Freeze schedule | VLM + transformer core frozen for first 1000 steps (only soft prompts + action heads train) |
| Iterations | 60,000 |
| Optimizer | AdamW, betas=(0.9, 0.95), wd=0.0, grad-clip 1.0 |
| Skill weights | recomputed from MP-radio's 4-skill distribution (see above) |
| Step | total | joints | skill_cls | progress |
|---|---|---|---|---|
| 0 | 15.67 | 15.11 | 0.545 | 0.006 |
| 1000 | 0.521 | 0.509 | 0.005 | 0.007 |
| 5000 | 0.126 | 0.120 | 0.001 | 0.006 |
| 10000 | 0.028 | 0.024 | 0.000 | 0.004 |
| 20000 | 0.029 | 0.026 | 0.000 | 0.003 |
| 30000 | 0.032 | 0.029 | 0.000 | 0.003 |
| 40000 | 0.024 | 0.023 | 0.000 | 0.001 |
| 50000 | 0.013 | 0.012 | 0.000 | 0.002 |
| 59980 | 0.014 | 0.011 | 0.000 | 0.003 |
task_prompt_hub[task_id] + skill_prompt_hub[skill_id]), 32 tokens × 1024 dim each, zero-initialized"Turn on the radio receiver. Current: move to radio."from transformers import AutoModel, AutoConfig
REPO = "Hoshipu/xvla-v20-task0-mp-radio-lr1e4-rw"
CKPT = "ckpt-60000"
config = AutoConfig.from_pretrained(REPO, subfolder=CKPT, trust_remote_code=True)
model = AutoModel.from_pretrained(REPO, subfolder=CKPT, trust_remote_code=True)
Or deploy via the WebSocket server in the repo:
git clone -b v20 https://github.com/markli1hoshipu/behavior1k-xvla.git
cd behavior1k-xvla && bash setup.sh
huggingface-cli download Hoshipu/xvla-v20-task0-mp-radio-lr1e4-rw \
--include "ckpt-60000/*" --local-dir ./xvla
cd behavior1k_training
python deploy_b1k.py --model_path ../xvla/ckpt-60000 --port 8000
ckpt-60000/)model.safetensors — final 60k-step weights (3.5 GB, bf16)config.json, preprocessor_config.json, tokenizer*, vocab.json, merges.txtmodeling_xvla.py, configuration_xvla.py, transformer.py — patched v20 modulesmodeling_florence2.py, configuration_florence2.py, action_hub.py, processing_xvla.py — unchanged from base