T2M-GPT

Model Description

These are model weights originally provided by the authors of the paper T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representations.

<figure> <img src="https://huggingface.co/vumichien/T2M-GPT/resolve/main/T2M-GPT.png" alt="T2M-VQ"> <figcaption>T2M-GPT </figcaption> </figure>

Conditional generative framework based on Vector QuantisedVariational AutoEncoder (VQ-VAE) and Generative Pretrained Transformer (GPT) for human motion generation from textural descriptions.

A simple CNN-based VQ-VAE with commonly used training recipes (EMA and Code Reset) allows us to obtain high-quality discrete representations

The official code of this paper in here

Example

<figure> <img src="https://huggingface.co/vumichien/T2M-GPT/resolve/main/demo_slow1.gif" alt="Demo Slow", width="425", height=480/> <figcaption> a man starts off in an up right position with botg arms extended out by his sides, he then brings his arms down to his body and claps his hands together. after this he wals down amd the the left where he proceeds to sit on a seat </figcaption> </figure> <figure> <img src="https://huggingface.co/vumichien/T2M-GPT/resolve/main/demo_slow2.gif" alt="Demo Slow 2", width="425", height=480/> <figcaption> a person puts their hands together, leans forwards slightly then swings the arms from right to left </figcaption> </figure>

Datasets

HumanML3D and KIT-ML