Downloads · 30 days
17
16% of all-time downloads
liruiw/hpt-large
hpt-large is a machine learning model from liruiw. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
Lirui Wang, Xinlei Chen, Jialiang Zhao, Kaiming He
Downloads · 30 days
17
16% of all-time downloads
All-time downloads
106
Public
Repo size
822 MB
Likes
0
Public
Click a slice to open those files.
.pth822 MB · 100%
From the Hugging Face model README
Lirui Wang, Xinlei Chen, Jialiang Zhao, Kaiming He
Neural Information Processing Systems (Spotlight), 2024
You can find more details on our project page. An alternative clean implementation of HPT in Hugging Face can also be found here.
TL;DR: HPT aligns different embodiment to a shared latent space and investigates the scaling behaviors in policy learning. Put a scalable transformer in the middle of your policy and don’t train from scratch!
If you find HPT useful in your research, please consider citing:
@inproceedings{wang2024hpt,
author = {Lirui Wang, Xinlei Chen, Jialiang Zhao, Kaiming He},
title = {Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers},
booktitle = {Neurips},
year = {2024}
}
If you have any questions, feel free to contact me through email ([email protected]). Enjoy!