Downloads · 30 days
96
0% of all-time downloads
Chemin-AI/llama3-8b-cpt-sahabatai-v1-instruct-gguf
llama3-8b-cpt-sahabatai-v1-instruct-gguf is a machine learning model from Chemin-AI. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.
This model was converted to GGUF format from GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct using llama.cpp. Refer to the original model card for more details on the model.
Downloads · 30 days
96
0% of all-time downloads
All-time downloads
36K
Public
Repo size
43.2 GB
Likes
4
Public
Click a slice to open those files.
.gguf43.2 GB · 100%
From the Hugging Face model README
This model was converted to GGUF format from [`GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct`](https://huggingface.co/GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct) using llama.cpp.
Refer to the [original model card](https://huggingface.co/GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct) for more details on the model.
## Available Versions
- `llama3-8b-cpt-sahabatai-v1-instruct.q2_k.gguf` (q2_k)
llama3-8b-cpt-sahabatai-v1-instruct.q3_k_m.gguf (q3_k_m)
llama3-8b-cpt-sahabatai-v1-instruct.q4_0.gguf (q4_0)
llama3-8b-cpt-sahabatai-v1-instruct.q4_k_m.gguf (q4_k_m)
llama3-8b-cpt-sahabatai-v1-instruct.q5_0.gguf (q5_0)
llama3-8b-cpt-sahabatai-v1-instruct.q5_k_m.gguf (q5_k_m)
llama3-8b-cpt-sahabatai-v1-instruct.q6_k.gguf (q6_k)
llama3-8b-cpt-sahabatai-v1-instruct.q8_0.gguf (q8_0)
## Use with llama.cpp
Replace `FILENAME` with one of the above filenames.
### CLI:
```bash
llama-cli --hf-repo Supa-AI/llama3-8b-cpt-sahabatai-v1-instruct-gguf --hf-file FILENAME -p "Your prompt here"
```
### Server:
```bash
llama-server --hf-repo Supa-AI/llama3-8b-cpt-sahabatai-v1-instruct-gguf --hf-file FILENAME -c 2048
```
## Model Details
- **Original Model:** [GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct](https://huggingface.co/GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct)
- **Format:** GGUF