Downloads · 30 days
39
10% of all-time downloads
DarkClaw42/Llama-3-Translation-8B-v0.180-Q5_K_M-GGUF
Llama-3-Translation-8B-v0.180-Q5_K_M-GGUF is a text generation model from DarkClaw42. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
This model was converted to GGUF format from lemon-mint/Llama-3-Translation-8B-v0.180 using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.
Downloads · 30 days
39
10% of all-time downloads
All-time downloads
398
Public
Repo size
5.8 GB
Likes
0
Public
Click a slice to open those files.
.gguf5.8 GB · 100%
From the Hugging Face model README
This model was converted to GGUF format from lemon-mint/Llama-3-Translation-8B-v0.180 using llama.cpp via the ggml.ai's GGUF-my-repo space.
Refer to the original model card for more details on the model.
Llama 3 Translation 8B v0.180 Eval Loss: 0.69922 Train Loss: 0.65752 lr: 8e-05 optimizer: adamw lr_scheduler_type: cosine
#Prompt Template <|begin_of_text|><|im_start|>user Translate into Korean:Hamsters don't eat cats.<|im_end|> <|im_start|>assistant 햄스터는 고양이를 먹지 않습니다.<|im_end|><|end_of_text|>
<|begin_of_text|><|im_start|>user Translate into English:햄스터는 고양이를 먹지 않습니다.<|im_end|> <|im_start|>assistant Hamsters do not eat cats.<|im_end|><|end_of_text|>
Install llama.cpp through brew (works on Mac and Linux)
brew install llama.cpp
Invoke the llama.cpp server or the CLI.
llama-cli --hf-repo DarkClaw42/Llama-3-Translation-8B-v0.180-Q5_K_M-GGUF --hf-file llama-3-translation-8b-v0.180-q5_k_m.gguf -p "The meaning to life and the universe is"
llama-server --hf-repo DarkClaw42/Llama-3-Translation-8B-v0.180-Q5_K_M-GGUF --hf-file llama-3-translation-8b-v0.180-q5_k_m.gguf -c 2048
Note: You can also use this checkpoint directly through the usage steps listed in the Llama.cpp repo as well.
Step 1: Clone llama.cpp from GitHub.
git clone https://github.com/ggerganov/llama.cpp
Step 2: Move into the llama.cpp folder and build it with LLAMA_CURL=1 flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
cd llama.cpp && LLAMA_CURL=1 make
Step 3: Run inference through the main binary.
./llama-cli --hf-repo DarkClaw42/Llama-3-Translation-8B-v0.180-Q5_K_M-GGUF --hf-file llama-3-translation-8b-v0.180-q5_k_m.gguf -p "<|begin_of_text|><|im_start|>user
Translate into Korean:Hamsters don't eat cats.<|im_end|>"
or
./llama-server --hf-repo DarkClaw42/Llama-3-Translation-8B-v0.180-Q5_K_M-GGUF --hf-file llama-3-translation-8b-v0.180-q5_k_m.gguf -c 2048