Downloads · 30 days
0
vihangd/open_llama_7b_700bt_ggml
open_llama_7b_700bt_ggml is a machine learning model from vihangd. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository contains the GGML models for the latest 700 billion token (700bt) preview of the Open Llama 7b model.
Downloads · 30 days
0
Access
Public
Updated May 25, 2023
Repo size
24.9 GB
Likes
8
Public
Click a slice to open those files.
.bin24.9 GB · 100%
From the Hugging Face model README
This repository contains the GGML models for the latest 700 billion token (700bt) preview of the Open Llama 7b model.
The following files can be used with llama.cpp or kobold.cpp:
ggml-model-q4_0.bin: Quantized model, 3.79 GBggml-model-q4_1.bin: Quantized model, 4.21 GBggml-model-q5_0.bin: Quantized model, 4.63 GBggml-model-q5_1.bin: Quantized model, 5.06 GBggml-model-q8_0.bin: Quantized model, 7.16 GB