Downloads · 30 days
3.8K
3% of all-time downloads
saiga_llama3_8b_gguf
IlyaGusev/saiga_llama3_8b_gguf
saiga_llama3_8b_gguf is a text generation model from IlyaGusev. Use it when you need the model to write or continue text. The card lists the license as other.
Llama.cpp compatible versions of an original 8B model.
All-time downloads
137K
Public
Repo size
229 GB
Likes
93
Public
Repo makeup
Click a slice to open those files.
.gguf32.7 GB · 100%
At a glance
- Task
- Text Generation
- License
- other
- Access
- Public
- Created
- Apr 19, 2024
- Updated
- Jul 4, 2024
- SHA
- d9e7e9e5
Datasets
Model card
From the Hugging Face model README
Llama.cpp compatible versions of an original 8B model.
Download one of the versions, for example model-q4_K.gguf.
wget https://huggingface.co/IlyaGusev/saiga_llama3_8b_gguf/resolve/main/model-q4_K.gguf
Download interact_llama3_llamacpp.py
wget https://raw.githubusercontent.com/IlyaGusev/rulm/master/self_instruct/src/interact_llama3_llamacpp.py
How to run:
pip install llama-cpp-python fire
python3 interact_llama3_llamacpp.py model-q4_K.gguf
System requirements:
- 10GB RAM for q8_0 and less for smaller quantizations
- Task
- Text Generation
- License
- other
- Languages
- ru
- Created
- Apr 19, 2024
- Updated
- Jul 4, 2024