Downloads · 30 days
18
15% of all-time downloads
snsnc/Qwopus3.5-9B-Coder-MLX
Qwopus3.5-9B-Coder-MLX is a text generation model from snsnc. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
MLX conversion of Jackrong/Qwopus3.5-9B-Coder for Apple Silicon.
Downloads · 30 days
18
15% of all-time downloads
All-time downloads
121
Public
Parameters
9B
17.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors17.9 GB · 100%
How the weights are stored.
BF169B · 100%
From the Hugging Face model README
MLX conversion of Jackrong/Qwopus3.5-9B-Coder for Apple Silicon.
Original upstream weights, converted to MLX format only. No additional fine-tuning or architecture changes.
pip install -U mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("snsnc/Qwopus3.5-9B-Coder-MLX")
prompt = "Write a short Python function that returns the factorial of a number."
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages,
add_generation_prompt=True,
return_dict=False,
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)
print(response)
pip install -U mlx-serve
mlx-serve \
--model hf://snsnc/Qwopus3.5-9B-Coder-MLX \
--serve \
--host 0.0.0.0 \
--port 11234
Jackrong/Qwopus3.5-9B-Coder