Downloads · 30 days
183
0% of all-time downloads
open_llama_3b_v2_gguf
SlyEcho/open_llama_3b_v2_gguf
open_llama_3b_v2_gguf is a machine learning model from SlyEcho. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
- Version: version 2 final - Project: OpenLLaMA: An Open Reproduction of LLaMA - Model: openlm-research/openllama3bv2 - llama.cpp: build 1012 (6381d4e) or later - ggml version
All-time downloads
37.8K
Public
Repo size
19.5 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf19.5 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Aug 31, 2023
- Updated
- Aug 31, 2023
- SHA
- 4d92e5d6
Model card
From the Hugging Face model README
gguf versions of OpenLLaMa 3B v2
- Version: version 2 final
- Project: OpenLLaMA: An Open Reproduction of LLaMA
- Model: openlm-research/open_llama_3b_v2
- llama.cpp: build 1012 (6381d4e) or later
- ggml version
Newer quantizations
There are now more quantization types in llama.cpp, some lower than 4 bits.
Currently these are not well supported because of technical reasons.
If you want to use them, you have to build llama.cpp (from build 829 (ff5d58f)) with the LLAMA_QKK_64 Make or CMake variable enabled (see PR #2001).
Then you can quantize the F16 or maybe Q8_0 version to what you want.
Perplexity on wiki.test.406
Coming soon...
- License
- apache-2.0
- Created
- Aug 31, 2023
- Updated
- Aug 31, 2023