Downloads · 30 days
9
5% of all-time downloads
hpt-large-lang
liruiw/hpt-large-lang
hpt-large-lang is a machine learning model from liruiw. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Lirui Wang, Xinlei Chen, Jialiang Zhao, Kaiming He
All-time downloads
192
Public
Repo size
861 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pth431 MB · 100%
At a glance
- Access
- Public
- Created
- Apr 11, 2024
- Updated
- Sep 27, 2024
- SHA
- 06827225
Model card
From the Hugging Face model README
🦾 Heterogenous Pre-trained Transformers
Lirui Wang, Xinlei Chen, Jialiang Zhao, Kaiming He
Neural Information Processing Systems (Spotlight), 2024
You can find more details on our project page. An alternative clean implementation of HPT in Hugging Face can also be found here.
TL;DR: HPT aligns different embodiment to a shared latent space and investigates the scaling behaviors in policy learning. Put a scalable transformer in the middle of your policy and don’t train from scratch!
If you find HPT useful in your research, please consider citing:
@inproceedings{wang2024hpt,
author = {Lirui Wang, Xinlei Chen, Jialiang Zhao, Kaiming He},
title = {Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers},
booktitle = {Neurips},
year = {2024}
}
Contact
If you have any questions, feel free to contact me through email ([email protected]). Enjoy!
- Created
- Apr 11, 2024
- Updated
- Sep 27, 2024