Downloads · 30 days
15
52% of all-time downloads
QianheChen01/Hy-MT2-30B-A3B-APEX-Imatrix-I-Compact-MLX
Hy-MT2-30B-A3B-APEX-Imatrix-I-Compact-MLX is a machine learning model from QianheChen01. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Converted locally from alphaZimuth/Hy-MT2-30B-A3B-APEX-GGUF/Hy-MT2-30B-A3B-APEX-Imatrix-I-Compact.gguf for oMLX/MLX inference.
Downloads · 30 days
15
52% of all-time downloads
All-time downloads
29
Public
Parameters
4.3B
15.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors15.1 GB · 100%
How the weights are stored.
U323.3B · 78%
From the Hugging Face model README
Converted locally from alphaZimuth/Hy-MT2-30B-A3B-APEX-GGUF/Hy-MT2-30B-A3B-APEX-Imatrix-I-Compact.gguf for oMLX/MLX inference.
The source GGUF mixed precision policy is preserved by mapping Q3_K/Q4_K/Q6_K tensors to MLX affine 3/4/6-bit modules with group size 64. Quantization parameters and ordinary floating weights use BF16; expert routing biases remain F32.
Source tensor types: {'F32': 287, 'Q3_K': 90, 'Q4_K': 250, 'Q6_K': 139}.