Downloads · 30 days
0
larryvrh/Baichuan2-13B-QKV
Baichuan2-13B-QKV is a machine learning model from larryvrh. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Script and modeling used to split Wpack into qproj, kproj, vproj for correct lora module injection.
Downloads · 30 days
0
Access
Public
Updated Sep 9, 2023
Repo size
—
Likes
2
Public
Click a slice to open those files.
.py33.4 KB · 95%
From the Hugging Face model README
Script and modeling used to split W_pack into q_proj, k_proj, v_proj for correct lora module injection.