Downloads · 30 days
29
20% of all-time downloads
ZhishanQ/UniHGKR-7B-pretrained
UniHGKR-7B-pretrained is a feature extraction model from ZhishanQ. Use it when you need embeddings to search or compare text. It is set up for transformers.
This is a large language model based retriever for heterogeneous knowledge retrieval, trained from LLARA.
Downloads · 30 days
29
20% of all-time downloads
All-time downloads
148
Public
Parameters
6.6B
13.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors13.2 GB · 100%
From the Hugging Face model README
This is a large language model based retriever for heterogeneous knowledge retrieval, trained from LLARA.
The model was trained after Stages 1 and 2. It needs to be fine-tuned before being used for an information retrieval task.
Our paper: UniHGKR: Unified Instruction-aware Heterogeneous Knowledge Retrievers.
Please see github repository UniHGKR to know how to use this model.
If you find this resource useful in your research, please consider giving a like and citation.
@article{min2024unihgkr,
title={UniHGKR: Unified Instruction-aware Heterogeneous Knowledge Retrievers},
author={Min, Dehai and Xu, Zhiyang and Qi, Guilin and Huang, Lifu and You, Chenyu},
journal={arXiv preprint arXiv:2410.20163},
year={2024}
}