bitvla-bf16

BitVLA-bf16

BitVLA-bf16 is an open, highly efficient 1-bit vision-language-action (VLA) model trained on ~1M robot manipulation episodes from the Open X-Embodiment dataset. Across simulation benchmarks and real-world tasks, BitVLA matches the performance of the full-precision OpenVLA-OFT baseline, while reducing model memory by 11.0× and end-to-end latency by 4.4×. All BitVLA checkpoints and our training codebase are released under an MIT License. For full details, please read our paper and see our GitHub Repository.

Note that we provide the master weights of BitVLA and perform online quantization. For actual memory savings, you may quantize the weights offline to 1.58-bit precision. We recommend using the bitnet.cpp inference framework to accurately measure the reduction in inference cost. A dedicated inference framework and model are coming soon.

Pre-training Details:

• Base model: We use hongyuw/bitvla-bitsiglipL-224px-bf16 as the base model.
• Dataset: Following OpenVLA, we use a curated large-scale corpus based on a subset of the Open X-Embodiment dataset, resulting in ~1M training samples.
• Hyperparameters: We train the model for 200K steps with a total batch size of 2048. The peak learning rates are set to 3×10⁻⁴ for the LLM and 1×10⁻⁴ for the ViT.
• Compute: The full pre-training takes approximately 14 days on 16 NVIDIA H800 (80GB) GPUs.

Citation

If you find this repository useful, please consider citing our work:

@article{bitvla,
  title={BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulation}, 
  author={Hongyu Wang and Chuyan Xiong and Ruiping Wang and Xilin Chen},
  year={2025},
  eprint={2506.07530},
  archivePrefix={arXiv},
  primaryClass={cs.RO},
}