Downloads · 30 days
0
openbuddy-openllama-7b-v5-q4_0
metalwhale/openbuddy-openllama-7b-v5-q4_0
openbuddy-openllama-7b-v5-q4_0 is a machine learning model from metalwhale. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
(The commit hashes are confirmed at the time of 2023/06/19)
Access
Public
Updated Jun 19, 2023
Repo size
3.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin3.8 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jun 19, 2023
- Updated
- Jun 19, 2023
- SHA
- 0e3b6447
Model card
From the Hugging Face model README
How to reproduce
# Prerequisites
apt update -y
apt install -y git git-lfs python3 python3-pip curl pkg-config libssl-dev
python3 -m pip install numpy==1.25.0 sentencepiece==0.1.99
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh && source "$HOME/.cargo/env"
# Clone repositories
git clone https://huggingface.co/OpenBuddy/openbuddy-openllama-7b-v5-fp16 # Commit hash 1fedac68b34952eecec849a5938b778d6004d632
git clone https://github.com/ggerganov/llama.cpp # Commit hash 16b9cd193965769089881bb8ec012fccca7b37b6
git clone --recurse-submodules https://github.com/rustformers/llm.git # Commit hash 3becd728c0d6eeb2d649f86158c7018d5aaaba40
# Build ggml model
cd llama.cpp/
python3 convert.py ../openbuddy-openllama-7b-v5-fp16/
cd ../llm/
cargo build --release
cargo run --release llama quantize ../openbuddy-openllama-7b-v5-fp16/ggml-model-f16.bin ../openbuddy-openllama-7b-v5-fp16/openbuddy-openllama-7b-v5-q4_0.bin q4_0
(The commit hashes are confirmed at the time of 2023/06/19)
- License
- apache-2.0
- Created
- Jun 19, 2023
- Updated
- Jun 19, 2023