Downloads · 30 days
23
3% of all-time downloads
MiniLoong-3B
GeneZC/MiniLoong-3B
MiniLoong-3B is a text generation model from GeneZC. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
📑 arXiv | 👻 GitHub | 🤗 HuggingFace-MiniMA-3B | 🤗 HuggingFace-MiniChat-3B | 🤖 ModelScope-MiniMA-3B | 🤖 ModelScope-MiniChat-3B | 🤗 HuggingFace-MiniChat-1.5-3B | 🤗 HuggingFace-MiniMA-2-3B | 🤗 HuggingFace-MiniCha…
All-time downloads
875
Public
Parameters
3B
12.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin6 GB · 50%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jul 9, 2024
- Updated
- Feb 10, 2025
- SHA
- 6eac6214
Try a prompt
Model card
From the Hugging Face model README
MiniLoong-3B
📑 arXiv | 👻 GitHub | 🤗 HuggingFace-MiniMA-3B | 🤗 HuggingFace-MiniChat-3B | 🤖 ModelScope-MiniMA-3B | 🤖 ModelScope-MiniChat-3B | 🤗 HuggingFace-MiniChat-1.5-3B | 🤗 HuggingFace-MiniMA-2-3B | 🤗 HuggingFace-MiniChat-2-3B | 🤗 HuggingFace-MiniMA-2-1B | 🤗 HuggingFace-MiniLoong-3B | 🤗 HuggingFace-MiniMix-2/4x3B
❗ Must comply with LICENSE of LLaMA-2 since it is derived from LLaMA-2.
<img src="./teaser_d.jpg" alt="teaser_d" width="700" />Bibtex
@article{zhang2023law,
title={Towards the Law of Capacity Gap in Distilling Language Models},
author={Zhang, Chen and Song, Dawei and Ye, Zheyu and Gao, Yan},
year={2023},
url={https://arxiv.org/abs/2311.07052}
}
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en, zh
- Created
- Jul 9, 2024
- Updated
- Feb 10, 2025