Downloads · 30 days
15
6% of all-time downloads
kingbri/kimiko-llongma-2-13B-16k-GPTQ
kimiko-llongma-2-13B-16k-GPTQ is a text generation model from kingbri. Use it when you need the model to write or continue text. It is set up for transformers.
This is a GPTQ quantized version of kimiko-llongma-2-13B-16k
Downloads · 30 days
15
6% of all-time downloads
All-time downloads
267
Public
Repo size
22.5 GB
Likes
0
Public
Click a slice to open those files.
.safetensors7.3 GB · 100%
From the Hugging Face model README
This is a GPTQ quantized version of kimiko-llongma-2-13B-16k
To run this model, make sure compress_pos_emb is set to 4 to apply proper rope scaling parameters. The max_ctx_len is 16384.
Branches: