SKEL_CF_vitpose_H

SKEL-CF: Coarse-to-Fine Biomechanical Skeleton and Surface Mesh Recovery

TL;DR: SKEL-CF is a coarse-to-fine transformer framework for estimating anatomically accurate SKEL parameters from 3D human data. By converting 4DHuman to SKEL-aligned 4DHuman-SKEL and incorporating camera modeling, it addresses data scarcity and depth/scale ambiguities. SKEL-CF outperforms prior SKEL-based methods on MOYO (85.0 MPJPE / 51.4 PA-MPJPE), offering a scalable, biomechanically faithful solution for human motion analysis.

<p align="center"> <img src="https://raw.githubusercontent.com/Pokerman8/SKEL-CF/main/static/images/teaser.jpg" alt="SKEL-CF Teaser Image"> </p>

Model Sources

<!-- Provide the basic links for the model. -->

• Repository: Intellindust-AI-Lab/SKEL-CF
• Paper (Hugging Face): SKEL-CF: Coarse-to-Fine Biomechanical Skeleton and Surface Mesh Recovery
• Paper (arXiv): SKEL-CF: Coarse-to-Fine Biomechanical Skeleton and Surface Mesh Recovery
• Project Page: SKEL-CF Project Page
• Demo: Github Demo

---

🗓️ Updates

• [2025.11.26] Release SKEL-CF.
• [2025.11.27] Release checkpoints and labels on Hugging Face.

🧭 Table of Content

• 1. ⚒️ Setup
• 2. 🚀 Demo & Quick Start
• 3. 🧱 Reproducibility
• 4. 👀 Visual Results
• 5. 📝 Citation
• 6. 📜 Acknowledgement
• 7. 🌟 Star History

⚒️ Setup

1. 🌏 Environment Setup
2. 📦 Data Preparation

🚀 Quick Start

Quick start with images:

bash vis/run_demo.sh

Quick start with videos:

bash vis/run_video.sh

🧱 Reproducibility

For reproducing the results in the paper, please refer to docs/EVAL.md and docs/TRAIN.md.

👀 Visual Results

Per-Layer Refinement

Sports Video

<a href="https://raw.githubusercontent.com/Pokerman8/SKEL-CF/main/static/videos/badminton01.mp4"> <img src="https://img.shields.io/badge/▶️-Badminton%20Video-FF6B6B?style=for-the-badge&logo=video" alt="Badminton Video" /> </a> <a href="https://raw.githubusercontent.com/Pokerman8/SKEL-CF/main/static/videos/skate01.mp4"> <img src="https://img.shields.io/badge/▶️-Skate%20Video-4ECDC4?style=for-the-badge&logo=video" alt="Skate Video" /> </a>

💡 Tip: Click the buttons above to watch videos, or visit our project page for more visual results.

📝 Citation

If you use SKEL-CF or its methods in your work, please cite the following BibTeX entries:

@article{li2025skelcf,
  title={SKEL-CF: Coarse-to-Fine Biomechanical Skeleton and Surface Mesh Recovery},
  author={Li, Da and Jin, Jiping and Yu, Xuanlong and Cun, Xiaodong and Chen, Kai and Fan, Rui and Kong, Jiangang and Shen, Xi},
  journal={arXiv},
  year={2025}
}

📜 Acknowledgement

Parts of the code are adapted from the following repos: SKEL, CameraHMR, HSMR, ViTPose, Detectron2

🌟 Star History