Downloads · 30 days
17
19% of all-time downloads
acpo-videollama2
amibaid/acpo-videollama2
acpo-videollama2 is a machine learning model from amibaid. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
VideoLLaMA2.1-7B-AV, fine-tuned with contrastive DPO on the audio projector so it grounds captions in the audio that's actually present instead of hallucinating sounds from visual cues.
All-time downloads
91
Public
Parameters
8.5B
17.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors17.1 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- videollama2_qwen2
- Access
- Public
- Created
- Jul 8, 2026
- Updated
- Jul 9, 2026
- SHA
- 1fcb16d5
Base models
Model card
From the Hugging Face model README
ACPO: Audio-Contrastive Preference Optimization
VideoLLaMA2.1-7B-AV, fine-tuned with contrastive DPO on the audio projector so it grounds captions in the audio that's actually present instead of hallucinating sounds from visual cues.
Checkpoint from "Don't Let the Video Speak: Audio-Contrastive Preference Optimization for Audio-Visual Language Models" (ECCV 2026).
Project page: https://vision.cs.utexas.edu/projects/acpo/
Code and benchmark: github.com/amibaid/ACPO
Training: 5k VALOR clips, audio projector only, β=0.1, lr=2e-5, 10 frames.
Usage
Standard VideoLLaMA2 checkpoint — load with the VideoLLaMA2 codebase.
huggingface-cli download amibaid/acpo-videollama2 --local-dir ckpt
Citation
@inproceedings{acpo2026,
title = {Don't Let the Video Speak: Audio-Contrastive Preference Optimization for Audio-Visual Language Models},
author = {Baid, Ami and Xue, Zihui and Grauman, Kristen},
booktitle = {ECCV},
year = {2026}
}
Released under Apache-2.0. The weights are additionally subject to the VideoLLaMA2 base-model license; the benchmark to AVHBench; training data to VALOR.
- Type
- videollama2_qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Jul 8, 2026
- Updated
- Jul 9, 2026