Downloads · 30 days
0
MMKE-Bench
kailinjiang/MMKE-Bench
MMKE-Bench is a machine learning model from kailinjiang. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
<p align="justify" We introduce <strong<span style="color:brown"MMKE-Bench</span</strong, a benchmark designed to evaluate the ability of LMMs to edit visual knowledge in real-world scenarios. <strong<span style="colo…
Access
Public
Updated Nov 6, 2024
Repo size
87.5 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pt68.2 GB · 80%
At a glance
- Access
- Public
- Created
- Oct 28, 2024
- Updated
- Nov 6, 2024
- SHA
- 80853d92
Model card
From the Hugging Face model README
🤗 Model
<p align="justify"> We introduce <strong><span style="color:brown">MMKE-Bench</span></strong>, a benchmark designed to evaluate the ability of LMMs to edit visual knowledge in real-world scenarios. <strong><span style="color:brown">MMKE-Bench</span></strong> incorporates three editing tasks: <strong><span style="color:brown">visual entity editing</span></strong>, <strong><span style="color:brown">visual semantic editing</span></strong>, and <strong><span style="color:brown">user-specific editing</span></strong>. Additionally, it uses free-form natural language to represent and edit knowledge, offering more flexibility. The benchmark includes <strong><span style="color:brown">2,940</span></strong> pieces of knowledge and <strong><span style="color:brown">7,229</span></strong> images across 110 fine-grained types, with automatically generated, human-verified evaluation questions. </p>You can download MMKE-Bench Model 🤗. ['KE','MEND','SERAC']
- Created
- Oct 28, 2024
- Updated
- Nov 6, 2024