Downloads · 30 days
3.8K
6% of all-time downloads
saiga_yandexgpt_8b_gguf
IlyaGusev/saiga_yandexgpt_8b_gguf
saiga_yandexgpt_8b_gguf is a machine learning model from IlyaGusev. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
Llama.cpp compatible versions of an original 8B model.
All-time downloads
66.9K
Public
Repo size
137 GB
Likes
36
Public
Repo makeup
Click a slice to open those files.
.gguf67.7 GB · 100%
At a glance
- License
- other
- Access
- Public
- Created
- Mar 4, 2025
- Updated
- Mar 13, 2025
- SHA
- e902caf8
Model card
From the Hugging Face model README
Llama.cpp compatible versions of an original 8B model.
Download one of the versions, for example saiga_yandexgpt_8b.Q4_K_M.gguf.
wget https://huggingface.co/IlyaGusev/saiga_yandexgpt_8b_gguf/resolve/main/saiga_yandexgpt_8b.Q4_K_M.gguf
Download interact_gguf.py
https://raw.githubusercontent.com/IlyaGusev/saiga/refs/heads/main/scripts/interact_gguf.py
How to run:
pip install llama-cpp-python fire
python3 interact_gguf.py saiga_yandexgpt_8b.Q4_K_M.gguf
System requirements:
- 9GB RAM for q8_0 and less for smaller quantizations
- License
- other
- Languages
- ru
- Created
- Mar 4, 2025
- Updated
- Mar 13, 2025