Downloads · 30 days
36
3% of all-time downloads
saiga2_7b_gguf
DFofanov78/saiga2_7b_gguf
saiga2_7b_gguf is a text generation model from DFofanov78. Use it when you need the model to write or continue text. The card lists the license as llama2.
Llama.cpp compatible versions of an original 7B model.
All-time downloads
1.3K
Public
Repo size
22.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf22.1 GB · 100%
At a glance
- Task
- Text Generation
- License
- llama2
- Access
- Public
- Created
- Mar 31, 2024
- Updated
- Mar 31, 2024
- SHA
- b674524d
Model card
From the Hugging Face model README
Llama.cpp compatible versions of an original 7B model.
Download one of the versions, for example model-q4_K.gguf.
wget https://huggingface.co/IlyaGusev/saiga2_7b_gguf/resolve/main/model-q4_K.gguf
Download interact_llamacpp.py
wget https://raw.githubusercontent.com/IlyaGusev/rulm/master/self_instruct/src/interact_llamacpp.py
How to run:
pip install llama-cpp-python fire
python3 interact_llamacpp.py model-q4_K.gguf
System requirements:
- 10GB RAM for q8_0 and less for smaller quantizations
- Task
- Text Generation
- License
- llama2
- Languages
- ru
- Created
- Mar 31, 2024
- Updated
- Mar 31, 2024