Downloads · 30 days
0
Flan-Open-Llama-3b-ggml
SlyEcho/Flan-Open-Llama-3b-ggml
Flan-Open-Llama-3b-ggml is a machine learning model from SlyEcho. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
- Announcement: Tweet by @EnricoShippole ("open-source") - Model: conceptofmind/Flan-Open-Llama-3b - Base Model: openlm-research/openllama3b OpenLLaMA: An Open Reproduction of LLaMA (Apache 2.0)
Access
Public
Updated Jul 13, 2023
Repo size
19.5 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin19.5 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jul 13, 2023
- Updated
- Jul 13, 2023
- SHA
- c5afa0b0
Model card
From the Hugging Face model README
ggml versions of Flan-Open-Llama-3b
- Announcement: Tweet by @EnricoShippole ("open-source")
- Model: conceptofmind/Flan-Open-Llama-3b
- Base Model: openlm-research/open_llama_3b OpenLLaMA: An Open Reproduction of LLaMA (Apache 2.0)
- Dataset: FLAN (Apache 2.0)
- llama.cpp: build 607(ffb06a3) or later
- Type: instruct
Use with llama.cpp
Support is now merged to master branch.
K-quants
There are now more quantization types in llama.cpp, some lower than 4 bits.
Currently these are not well supported because of technical reasons.
If you want to use them, you have to build llama.cpp (from build 829 (ff5d58f)) with the LLAMA_QKK_64 Make or CMake variable enabled (see PR #2001).
Then you can quantize the F16 or maybe Q8_0 version to what you want.
- License
- apache-2.0
- Created
- Jul 13, 2023
- Updated
- Jul 13, 2023