Downloads · 30 days
7
21% of all-time downloads
bradeenl/cwm-q4-mlx
cwm-q4-mlx is a machine learning model from bradeenl. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as fair-noncommercial-research-license.
This repository contains the MLX conversion of CWM with a 4bit quantization.
Downloads · 30 days
7
21% of all-time downloads
All-time downloads
33
Public
Parameters
32.6B
18.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors18.3 GB · 100%
How the weights are stored.
U324.1B · 80%
From the Hugging Face model README
This repository contains the MLX conversion of CWM with a 4bit quantization.
mlx-lm mlx_lm.generate --model . --prompt "hello"
==========
Hello! It's nice to meet you. Is there something I can help you with or would you like to chat?
</think>
==========
Prompt: 14 tokens, 20.107 tokens-per-sec
Generation: 28 tokens, 18.347 tokens-per-sec
Peak memory: 18.408 GB