Gesture-axera

Axera-Gesture

This version of Axera-Gesture has been converted to run on the Axera NPU using w8a16 quantization. It is mainly used for gesture detection in conventional scenarios.

Supported Classes

This model is trained to detect the following 3 classes:

1. ok
2. like
3. stop

Compatible with Pulsar2 version: 5.0.

Convert tools links:

For those who are interested in model conversion, you can try to export axmodel through:

• The repo of AXera Platform, where you can get the detailed guide.
• Pulsar2 Link, How to Convert ONNX to axmodel

Support Platform

https://docs.m5stack.com/zh_CN/ai_hardware/AI_Pyramid-Pro

• AX650N/AX8850
  • M4N-Dock(爱芯派Pro)
  • AI Pyramid
  • M.2 Accelerator card
• AX620E
  • 爱芯派2
  • Module-LLM

How to use

Download all files from this repository to the device.

python env requirement

pyaxengine

https://github.com/AXERA-TECH/pyaxengine

wget https://github.com/AXERA-TECH/pyaxengine/releases/download/0.1.3.rc2/axengine-0.1.3-py3-none-any.whl
pip install axengine-0.1.3-py3-none-any.whl

Inference with AX650 Host, such as M4N-Dock(爱芯派Pro)

Input image:

run

python3 ax_ges_infer.py --model ./AX650/ax_ax650_gesture_algo_ok_like_stop_V1.0.0.axmodel --img ges_1280_720.jpg

root@ax650:/ges# python3 ax_ges_infer.py --model ./AX650/ax_ax650_gesture_algo_ok_like_stop_V1.0.0.axmodel --img ges_1280_720.jpg
[INFO] Available providers:  ['AxEngineExecutionProvider']
[INFO] Using provider: AxEngineExecutionProvider
[INFO] Chip type: ChipType.MC50
[INFO] VNPU type: VNPUType.DISABLED
[INFO] Engine version: 2.10.1s
[INFO] Model type: 2 (triple core)
[INFO] Compiler version: 6.0 79a1e641
Input_name: images, Output_name: ['output0', 'output1']
Preprocess time: 6.94 ms
Inference time: 18.12 ms
Total detect 3 objects
0: ok    0.936 [86.0, 100.0, 207.0, 263.0]
1: like  0.910 [633.0, 277.0, 713.0, 392.0]
2: stop  0.929 [1096.0, 235.0, 1200.0, 384.0]

Output image: