Downloads · 30 days
0
saiga_13b_ggml
IlyaGusev/saiga_13b_ggml
saiga_13b_ggml is a text generation model from IlyaGusev. Use it when you need the model to write or continue text.
Llama.cpp compatible versions of an original 13B model.
Access
Public
Updated Jul 26, 2023
Repo size
97.6 GB
Likes
18
Public
Repo makeup
Click a slice to open those files.
.bin31.7 GB · 100%
At a glance
- Task
- Text Generation
- Access
- Public
- Created
- May 15, 2023
- Updated
- Jul 26, 2023
- SHA
- 8bcfc322
Spaces
Model card
From the Hugging Face model README
Llama.cpp compatible versions of an original 13B model.
- Download one of the versions, for example
ggml-model-q4_1.bin. - Download interact_llamacpp.py
How to run:
sudo apt-get install git-lfs
pip install llama-cpp-python fire
python3 interact_llamacpp.py ggml-model-q4_1.bin
System requirements:
- 18GB RAM for q8_0
- 13GB RAM for q4_1
- Task
- Text Generation
- Languages
- ru
- Created
- May 15, 2023
- Updated
- Jul 26, 2023