Downloads · 30 days
0
saiga_30b_ggml
IlyaGusev/saiga_30b_ggml
saiga_30b_ggml is a text generation model from IlyaGusev. Use it when you need the model to write or continue text.
Llama.cpp compatible version of an original 30B model.
Access
Public
Updated Jul 26, 2023
Repo size
140 GB
Likes
21
Public
Repo makeup
Click a slice to open those files.
.bin94.9 GB · 100%
At a glance
- Task
- Text Generation
- Access
- Public
- Created
- Apr 27, 2023
- Updated
- Jul 26, 2023
- SHA
- 058b45c8
Model card
From the Hugging Face model README
Llama.cpp compatible version of an original 30B model.
- Download
ggml-model-q4_1.bin. - Download interact_llamacpp.py
How to run:
sudo apt-get install git-lfs
pip install llama-cpp-python fire
python3 interact_llamacpp.py ggml-model-q4_1.bin
System requirements:
- 32GB RAM
- CPU with 4 cores
- Task
- Text Generation
- Languages
- ru
- Created
- Apr 27, 2023
- Updated
- Jul 26, 2023