Downloads · 30 days
5
9% of all-time downloads
Kunger/Sakura-13B-Qwen2beta-v0.9-4bit-GS64-AWQ
Sakura-13B-Qwen2beta-v0.9-4bit-GS64-AWQ is a text generation model from Kunger. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-sa-4.0.
原始模型:https://huggingface.co/SakuraLLM/Sakura-13B-Qwen2beta-v0.9
Downloads · 30 days
5
9% of all-time downloads
All-time downloads
58
Public
Parameters
14.2B
9.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors9.9 GB · 100%
How the weights are stored.
I3212.6B · 89%
From the Hugging Face model README
原始模型:https://huggingface.co/SakuraLLM/Sakura-13B-Qwen2beta-v0.9
4Bit AWQ量化,未测试,不建议使用。
GroupSize=64
适用于Kaggle双卡推理。