Downloads · 30 days
310
0% of all-time downloads
saiga2_13b_gguf
IlyaGusev/saiga2_13b_gguf
saiga2_13b_gguf is a text generation model from IlyaGusev. Use it when you need the model to write or continue text. The card lists the license as llama2.
Llama.cpp compatible versions of an original 13B model.
All-time downloads
118K
Public
Repo size
86.3 GB
Likes
50
Public
Repo makeup
Click a slice to open those files.
.gguf42.7 GB · 100%
At a glance
- Task
- Text Generation
- License
- llama2
- Access
- Public
- Created
- Jul 26, 2023
- Updated
- Sep 26, 2023
- SHA
- 35931cf7
Datasets
Model card
From the Hugging Face model README
Llama.cpp compatible versions of an original 13B model.
Download one of the versions, for example model-q4_K.gguf.
wget https://huggingface.co/IlyaGusev/saiga2_13b_gguf/resolve/main/model-q4_K.gguf
Download interact_llamacpp.py
wget https://raw.githubusercontent.com/IlyaGusev/rulm/master/self_instruct/src/interact_llamacpp.py
How to run:
pip install llama-cpp-python fire
python3 interact_llamacpp.py model-q4_K.gguf
System requirements:
- 18GB RAM for q8_K
- 10GB RAM for q4_K
- Task
- Text Generation
- License
- llama2
- Languages
- ru
- Created
- Jul 26, 2023
- Updated
- Sep 26, 2023