Downloads · 30 days
120
2% of all-time downloads
saiga2_70b_gguf
IlyaGusev/saiga2_70b_gguf
saiga2_70b_gguf is a text generation model from IlyaGusev. Use it when you need the model to write or continue text. The card lists the license as llama2.
Llama.cpp compatible versions of an original 70B model.
All-time downloads
4.8K
Public
Repo size
72.4 GB
Likes
12
Public
Repo makeup
Click a slice to open those files.
.gguf72.4 GB · 100%
At a glance
- Task
- Text Generation
- License
- llama2
- Access
- Public
- Created
- Sep 4, 2023
- Updated
- Sep 4, 2023
- SHA
- dc533dab
Datasets
Model card
From the Hugging Face model README
Llama.cpp compatible versions of an original 70B model.
- Download one of the versions, for example
ggml-model-q4_1.gguf. - Download interact_llamacpp.py
How to run:
sudo apt-get install git-lfs
pip install llama-cpp-python fire
python3 interact_llamacpp.py ggml-model-q4_1.gguf
System requirements:
- 45GB RAM for q4_1
- Task
- Text Generation
- License
- llama2
- Languages
- ru
- Created
- Sep 4, 2023
- Updated
- Sep 4, 2023