Downloads · 30 days
263
23% of all-time downloads
translategemma-4b-it-Q4_K_M_GGUF
azmnc/translategemma-4b-it-Q4_K_M_GGUF
translategemma-4b-it-Q4_K_M_GGUF is a translation model from azmnc. Use it when you need text moved from one language to another. It is set up for transformers. The card lists the license as gemma.
This model has been quantized to enable google/translategemma-4b-it model to run with the llama-server component of llama.cpp.
All-time downloads
1.2K
Public
Repo size
2.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf2.5 GB · 100%
At a glance
- Task
- Translation
- Library
- transformers
- License
- gemma
- Access
- Public
- Created
- Jan 27, 2026
- Updated
- Feb 19, 2026
- SHA
- d40cd496
Try a prompt
Base models
Model card
From the Hugging Face model README
azmnc/translategemma-4b-it-Q4_K_M_GGUF
This model has been quantized to enable google/translategemma-4b-it model to run with the llama-server component of llama.cpp.
Quantization
Q4_K_M
How to use
prompt
source_language_code[sprt]target_language_code[sprt]Text to translate
example
ja[sprt]en[sprt]日本で一番高い山は富士山です。
It will be translated as follows:
The highest mountain in Japan is Mount Fuji.
llama-server
[llama.cpp_dir]/llama-server -m [model_dir]/translategemma-4b-it-Q4_K_M_GGUF.gguf --port 8080 --jinja
Link
The details regarding the creation of this quantized model are summarized in the following article.
- Task
- Translation
- Library
- transformers
- License
- gemma
- Created
- Jan 27, 2026
- Updated
- Feb 19, 2026