Downloads · 30 days
16
52% of all-time downloads
QianheChen01/Hy-MT2-30B-A3B-APEX-Imatrix-I-Nano-MLX
Hy-MT2-30B-A3B-APEX-Imatrix-I-Nano-MLX is a machine learning model from QianheChen01. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Converted locally from alphaZimuth/Hy-MT2-30B-A3B-APEX-GGUF/Hy-MT2-30B-A3B-APEX-Imatrix-I-Nano.gguf for oMLX/MLX inference.
Downloads · 30 days
16
52% of all-time downloads
All-time downloads
31
Public
Parameters
3.7B
13 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors13 GB · 100%
How the weights are stored.
U322.8B · 75%
From the Hugging Face model README
Converted locally from alphaZimuth/Hy-MT2-30B-A3B-APEX-GGUF/Hy-MT2-30B-A3B-APEX-Imatrix-I-Nano.gguf for oMLX/MLX inference.
The source GGUF mixed precision policy is preserved by mapping IQ2_XXS/IQ2_S/Q3_K/Q4_K/Q5_K/Q6_K tensors to MLX affine 2/3/4/5/6-bit modules with group size 64. Quantization parameters and ordinary floating weights use F16; expert routing biases remain F32.
Source tensor types: {'F32': 287, 'IQ2_S': 30, 'IQ2_XXS': 60, 'Q3_K': 163, 'Q4_K': 114, 'Q5_K': 27, 'Q6_K': 85}.