Downloads · 30 days
42
14% of all-time downloads
hpt-xlarge
liruiw/hpt-xlarge
hpt-xlarge is a machine learning model from liruiw. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Lirui Wang, Xinlei Chen, Jialiang Zhao, Kaiming He
All-time downloads
308
Public
Repo size
5.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pth2.6 GB · 100%
At a glance
- Access
- Public
- Created
- May 15, 2024
- Updated
- Sep 27, 2024
- SHA
- 0adad50d
Model card
From the Hugging Face model README
🦾 Heterogenous Pre-trained Transformers
Lirui Wang, Xinlei Chen, Jialiang Zhao, Kaiming He
Neural Information Processing Systems (Spotlight), 2024
You can find more details on our project page. An alternative clean implementation of HPT in Hugging Face can also be found here.
TL;DR: HPT aligns different embodiment to a shared latent space and investigates the scaling behaviors in policy learning. Put a scalable transformer in the middle of your policy and don’t train from scratch!
If you find HPT useful in your research, please consider citing:
@inproceedings{wang2024hpt,
author = {Lirui Wang, Xinlei Chen, Jialiang Zhao, Kaiming He},
title = {Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers},
booktitle = {Neurips},
year = {2024}
}
Contact
If you have any questions, feel free to contact me through email ([email protected]). Enjoy!
- Created
- May 15, 2024
- Updated
- Sep 27, 2024