Downloads · 30 days
22
12% of all-time downloads
mpasila/Llama-3.1-Swallow-JP-EN-Translator-v1-8B
Llama-3.1-Swallow-JP-EN-Translator-v1-8B is a text generation model from mpasila. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.3.
Downloads · 30 days
22
12% of all-time downloads
All-time downloads
190
Public
Parameters
8B
16.1 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
Prompt format: ChatML
Recommended system prompt: You are a helpful assistant that translates Japanese to English.
Recommended sampling settings: temperature 0.5 (or lower), repetition penalty 1.04 (or higher if needed)
LoRA: mpasila/Llama-3.1-Swallow-JP-EN-Translator-v1-LoRA-8B
Seems to perform better when translating from Japanese to English. Doing English to Japanese doesn't seem to really work.
Training used LoRA rank 128 and alpha set to 32. Context length was set to 16384. But the there's more data in 8k context length so using 8k context length will likely perform better.
Training data was this: mpasila/ParallelFiction-Ja_En-1k-16k-Gemma-3-ShareGPT-Filtered
Original dataset (before filtering/cleaning): NilanE/ParallelFiction-Ja_En-100k
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.