Downloads · 30 days
0
MILVLG/Imp-v1.5-3B-196-q4f16_1-MLC
Imp-v1.5-3B-196-q4f16_1-MLC is a text generation model from MILVLG. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
To fit the MLC framework for mobile devices, we further perform the 4-bit quantization to Imp-v1.5-3B-196 to obtain Imp-v1.5-3B-196-q4f161-MLC.
Downloads · 30 days
0
Access
Public
Updated May 23, 2024
Repo size
1.8 GB
Likes
0
Public
Click a slice to open those files.
.bin1.8 GB · 100%
From the Hugging Face model README
To fit the MLC framework for mobile devices, we further perform the 4-bit quantization to Imp-v1.5-3B-196 to obtain Imp-v1.5-3B-196-q4f16_1-MLC.
To use this model on moblie devices, please refer to the mlc-imp project.
This project is licensed under the Apache License 2.0 - see the LICENSE file for details.
If you use our model or refer our work in your studies, please cite:
@article{imp2024,
title={Imp: Highly Capable Large Multimodal Models for Mobile Devices},
author={Shao, Zhenwei and Yu, Zhou and Yu, Jun and Ouyang, Xuecheng and Zheng, Lihao and Gai, Zhenbiao and Wang, Mingyang and Ding, Jiajun},
journal={arXiv preprint arXiv:2405.12107},
year={2024}
}