Downloads · 30 days
0
Video-CCAM-9B
JaronTHU/Video-CCAM-9B
Video-CCAM-9B is a machine learning model from JaronTHU. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Video-CCAM-9B is a Video-MLLM built on Yi-1.5-9B-Chat and SigLIP SO400M.
Access
Public
Updated Jul 16, 2024
Repo size
3.7 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin3.7 GB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Jun 27, 2024
- Updated
- Jul 16, 2024
- SHA
- 614c648e
Model card
From the Hugging Face model README
Model Summary
Video-CCAM-9B is a Video-MLLM built on Yi-1.5-9B-Chat and SigLIP SO400M.
Usage
Inference using Huggingface transformers on NVIDIA GPUs. Requirements tested on python 3.10：
torch==2.1.0
torchvision==0.16.0
transformers==4.40.2
peft==0.10.0
Inference & Evaluation
Please refer to Video-CCAM on inference and evaluation.
Video-MME
| #Frames. | 32 | 96 |
|---|---|---|
| w/o subs | 50.0 | 50.6 |
| w subs | 53.1 | 54.9 |
MVBench: 60.70 (16 frames)
Acknowledgement
- xtuner: Video-CCAM-9B is trained using the xtuner framework. Thanks for their excellent works!
- Yi-1.5-9B-Chat: Great language models developed by 01.AI.
- SigLIP SO400M: Outstanding vision encoder developed by Google.
License
The model is licensed under the MIT license.
- License
- mit
- Created
- Jun 27, 2024
- Updated
- Jul 16, 2024