Downloads · 30 days
15
7% of all-time downloads
introvoyz041/YanoljaNEXT-Rosetta-4B-2511-mlx-4Bit
YanoljaNEXT-Rosetta-4B-2511-mlx-4Bit is a translation model from introvoyz041. Use it when you need text moved from one language to another. It is set up for transformers. The card lists the license as gemma.
The Model introvoyz041/YanoljaNEXT-Rosetta-4B-2511-mlx-4Bit was converted to MLX format from yanolja/YanoljaNEXT-Rosetta-4B-2511 using mlx-lm version 0.28.3.
Downloads · 30 days
15
7% of all-time downloads
All-time downloads
206
Public
Parameters
3.9B
2.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.2 GB · 98%
How the weights are stored.
U323.9B · 100%
From the Hugging Face model README
The Model introvoyz041/YanoljaNEXT-Rosetta-4B-2511-mlx-4Bit was converted to MLX format from yanolja/YanoljaNEXT-Rosetta-4B-2511 using mlx-lm version 0.28.3.
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("introvoyz041/YanoljaNEXT-Rosetta-4B-2511-mlx-4Bit")
prompt="hello"
if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, tokenize=False, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)