Downloads · 30 days
10
30% of all-time downloads
UnslopNemo-12B-v4_mlx-8bit
heni86/UnslopNemo-12B-v4_mlx-8bit
UnslopNemo-12B-v4_mlx-8bit is a machine learning model from heni86. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Quantized to 8-bit precision and tested using the mlxlm utility on a 64GiB URAM M1 Max.
All-time downloads
33
Public
Parameters
3.4B
13 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors13 GB · 100%
Parameter types
How the weights are stored.
U323.1B · 89%
Model card
From the Hugging Face model README
MLX Format and Quantizations for Unslop Nemo 12b v4
Quantized to 8-bit precision and tested using the mlx_lm utility on a 64GiB URAM M1 Max.
See original model for further details.
- Type
- mistral
- Created
- Oct 25, 2024
- Updated
- Oct 25, 2024