Downloads · 30 days
0
ggml-vicuna-7b-4bit
chharlesonfire/ggml-vicuna-7b-4bit
ggml-vicuna-7b-4bit is a machine learning model from chharlesonfire. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Source: https://huggingface.co/chharlesonfire/ggml-vicuna-7b-f16
Access
Public
Updated Apr 12, 2023
Repo size
4.2 GB
Likes
11
Public
Repo makeup
Click a slice to open those files.
.bin4.2 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Apr 12, 2023
- Updated
- Apr 12, 2023
- SHA
- 0d7df93f
Model card
From the Hugging Face model README
convert ggml-vicuna-7b-f16 to ggml-vicuna-7b-q4_0
Source: https://huggingface.co/chharlesonfire/ggml-vicuna-7b-f16
No unnecessary changes
Usage:
-
Download llama.cpp from https://github.com/ggerganov/llama.cpp
-
make and run llama.cpp and choose model with ggml-vicuna-7b-q4_0.bin
- License
- apache-2.0
- Created
- Apr 12, 2023
- Updated
- Apr 12, 2023