Downloads · 30 days
19
4% of all-time downloads
MemoryDecoder-Qwen-biomed
Clover-Hill/MemoryDecoder-Qwen-biomed
MemoryDecoder-Qwen-biomed is a machine learning model from Clover-Hill. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This Memory Decoder model is trained on the Biomedical domain and can be adapted to enhance any model in the Qwen2 and Qwen2.5 families.
All-time downloads
502
Public
Repo size
5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin2.5 GB · 99%
At a glance
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Oct 20, 2025
- Updated
- Oct 20, 2025
- SHA
- cd16a609
Base models
Model card
From the Hugging Face model README
Model Description
This Memory Decoder model is trained on the Biomedical domain and can be adapted to enhance any model in the Qwen2 and Qwen2.5 families.
Paper: Memory Decoder: A Pretrained, Plug-and-Play Memory for Large Language Models
GitHub: https://github.com/LUMIA-Group/MemoryDecoder
Training & Evaluation Data
Biomedical Domain Dataset: mimic_iii_diagnosis_anonymous
Test Split: MemoryDecoder-domain-data
Performance Results
Qwen2 Family
| Model | Base Model | Base + MemDec |
|---|---|---|
| Qwen2-0.5B | 18.41 | 3.75 |
| Qwen2-1.5B | 12.42 | 3.68 |
| Qwen2-7B | 8.36 | 3.59 |
| Qwen2-72B | 6.15 | 3.45 |
Qwen2.5 Family
| Model | Base Model | Base + MemDec |
|---|---|---|
| Qwen2.5-0.5B | 17.01 | 3.74 |
| Qwen2.5-1.5B | 11.33 | 3.67 |
| Qwen2.5-3B | 9.70 | 3.63 |
| Qwen2.5-7B | 8.19 | 3.57 |
| Qwen2.5-14B | 7.01 | 3.51 |
| Qwen2.5-32B | 6.65 | 3.48 |
| Qwen2.5-72B | 5.90 | 3.44 |
Perplexity scores on Biomedical domain test set. Lower is better.
Citation
@article{cao2025memory,
title={Memory decoder: A pretrained, plug-and-play memory for large language models},
author={Cao, Jiaqi and Wang, Jiarui and Wei, Rubin and Guo, Qipeng and Chen, Kai and Zhou, Bowen and Lin, Zhouhan},
journal={arXiv preprint arXiv:2508.09874},
year={2025}
}
Contact
For questions and support: [email protected]
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Oct 20, 2025
- Updated
- Oct 20, 2025