Downloads · 30 days
335
6% of all-time downloads
wcyno23/FlexRAG
FlexRAG is a machine learning model from wcyno23. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
FlexRAG is a lightweight model designed to reduce RAG running costs while improving its generation quality. It compresses the retrieved contexts into compact embeddings and these embeddings are optimized to enhance do…
Downloads · 30 days
335
6% of all-time downloads
All-time downloads
5.7K
Public
Parameters
1.8B
7 GB on disk
Likes
1
Public
Click a slice to open those files.
.bin3.5 GB · 50%
From the Hugging Face model README
FlexRAG is a lightweight model designed to reduce RAG running costs while improving its generation quality. It compresses the retrieved contexts into compact embeddings and these embeddings are optimized to enhance downstream RAG performance. A key feature of FlexRAG is its flexibility, which enables effective support for diverse compression ratios and selective preservation of important contexts.
For the usage of this model, please refer to [Github Repo]
@inproceedings{wu2025lighter,
title={Lighter and better: Towards flexible context adaptation for retrieval augmented generation},
author={Wu, Chenyuan and Shao, Ninglu and Liu, Zheng and Xiao, Shitao and Li, Chaozhuo and Zhang, Chen and Wang, Senzhang and Lian, Defu},
booktitle={Proceedings of the Eighteenth ACM International Conference on Web Search and Data Mining},
pages={271--280},
year={2025}
}