Downloads · 30 days
6
6% of all-time downloads
KV_shifting_2.9B
xumingyu16/KV_shifting_2.9B
KV_shifting_2.9B is a machine learning model from xumingyu16. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
I have discovered an open-source implementation for KV Shifting Attention. https://github.com/erogol/BlaGPT
All-time downloads
107
Public
Repo size
5.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin5.8 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- baichuan
- Access
- Public
- Created
- Nov 26, 2024
- Updated
- Dec 16, 2024
- SHA
- 9142ba31
Model card
From the Hugging Face model README
I have discovered an open-source implementation for KV Shifting Attention. https://github.com/erogol/BlaGPT
If you want to get started quickly, you can use 8 A100 and verify it in 2 hours.
- Type
- baichuan
- License
- apache-2.0
- Created
- Nov 26, 2024
- Updated
- Dec 16, 2024