Downloads · 30 days
0
dareposte/WizardLM-30b-V1.0-ggml
WizardLM-30b-V1.0-ggml is a machine learning model from dareposte. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GGML variant of WizardLM-30b-V1.0, for use on 24GB cards such as 3090.
Downloads · 30 days
0
Access
Public
Updated Jun 15, 2023
Repo size
39.2 GB
Likes
0
Public
Click a slice to open those files.
.bin19.6 GB · 100%
From the Hugging Face model README
GGML variant of WizardLM-30b-V1.0, for use on 24GB cards such as 3090.
Update pushed 6/14 that resolved garbage output on llama.cpp, not tested using other tools.
Requires a recent build of llama.cpp that supports the K-quant methods (June or later).
Quant was prepared using llama.cpp build on 6/14/2023.