Downloads · 30 days
6
30% of all-time downloads
HawkEye
wangyueqian/HawkEye
HawkEye is a visual question answering model from wangyueqian. Use it for the visual question answering task on the model card, and read the license before you ship it in a product. The card lists the license as llama2.
This repo provides the checkpoint of HawkEye, and our implementation of VideoChat2.
All-time downloads
20
Public
Repo size
5.4 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.pth3.9 GB · 100%
At a glance
- Task
- Visual Question Answering
- License
- llama2
- Access
- Public
- Created
- Mar 14, 2024
- Updated
- Apr 30, 2024
- SHA
- 655f6808
Model card
From the Hugging Face model README
<div style="display: flex; align-items: center;"> <img src="https://github.com/yellow-binary-tree/HawkEye/blob/main/assets/hawk.png?raw=True" alt="logo" width="50" height="50" style="margin: 0 10;"> <span style="margin: 10 10;"> HawkEye: Training Video-Text LLMs for Grounding Text in Videos</span> </div>
This repo provides the checkpoint of HawkEye, and our implementation of VideoChat2.
videochat2-stage3-our_impl.pth is the chekepoint of our reproduce of VideoChat2. You can use it as an substitution of hawkeye.pth.
- The difference between it and HawkEye is: not trained with data from InternVid-G.
- The difference between it and the original implementation of VideoChat2 is: the visual encoder is frozen, and not trained with image data from VideoChat2-IT
- Task
- Visual Question Answering
- License
- llama2
- Languages
- en
- Created
- Mar 14, 2024
- Updated
- Apr 30, 2024