Downloads · 30 days
22
4% of all-time downloads
AlirezaF138/persian_llama_7B_merged-Q6_K-GGUF
persian_llama_7B_merged-Q6_K-GGUF is a text generation model from AlirezaF138. Use it when you need the model to write or continue text. The card lists the license as bsd.
This model was converted to GGUF format from mostafaamiri/persianllama7Bmerged using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.
Downloads · 30 days
22
4% of all-time downloads
All-time downloads
597
Public
Repo size
5.7 GB
Likes
1
Public
Click a slice to open those files.
.gguf5.7 GB · 100%
From the Hugging Face model README
This model was converted to GGUF format from mostafaamiri/persian_llama_7B_merged using llama.cpp via the ggml.ai's GGUF-my-repo space.
Refer to the original model card for more details on the model.
Install llama.cpp through brew.
brew install ggerganov/ggerganov/llama.cpp
Invoke the llama.cpp server or the CLI.
CLI:
llama-cli --hf-repo AlirezaF138/persian_llama_7B_merged-Q6_K-GGUF --model persian_llama_7b_merged.Q6_K.gguf -p "The meaning to life and the universe is"
Server:
llama-server --hf-repo AlirezaF138/persian_llama_7B_merged-Q6_K-GGUF --model persian_llama_7b_merged.Q6_K.gguf -c 2048
Note: You can also use this checkpoint directly through the usage steps listed in the Llama.cpp repo as well.
git clone https://github.com/ggerganov/llama.cpp && cd llama.cpp && make && ./main -m persian_llama_7b_merged.Q6_K.gguf -n 128