Downloads · 30 days
0
open_llama_3b_ggml
SlyEcho/open_llama_3b_ggml
open_llama_3b_ggml is a machine learning model from SlyEcho. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
- Version: 1T tokens final version - Project: OpenLLaMA: An Open Reproduction of LLaMA - Model: openlm-research/openllama3b - llama.cpp: build 607(ffb06a3) or later
Access
Public
Updated Jun 22, 2023
Repo size
58.5 GB
Likes
28
Public
Repo makeup
Click a slice to open those files.
.bin19.5 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- May 30, 2023
- Updated
- Jun 22, 2023
- SHA
- 795a1948
Model card
From the Hugging Face model README
ggml versions of OpenLLaMa 3B
- Version: 1T tokens final version
- Project: OpenLLaMA: An Open Reproduction of LLaMA
- Model: openlm-research/open_llama_3b
- llama.cpp: build 607(ffb06a3) or later
Use with llama.cpp
Support is now merged to master branch.
Newer quantizations
There are now more quantization types in llama.cpp, some lower than 4 bits. Currently these are not supported, maybe because some weights have shapes that don't divide by 256.
Perplexity on wiki.test.raw
| Q | chunk | 600BT | 1000BT |
|---|---|---|---|
| F16 | [616] | 8.4656 | 7.7861 |
| Q8_0 | [616] | 8.4667 | 7.7874 |
| Q5_1 | [616] | 8.5072 | 7.8424 |
| Q5_0 | [616] | 8.5156 | 7.8474 |
| Q4_1 | [616] | 8.6102 | 8.0483 |
| Q4_0 | [616] | 8.6674 | 8.0962 |
- License
- apache-2.0
- Created
- May 30, 2023
- Updated
- Jun 22, 2023