Downloads · 30 days
20
17% of all-time downloads
nightmedia/Qwen3-30B-A3B-Element7-1M-qx64-hi-mlx
Qwen3-30B-A3B-Element7-1M-qx64-hi-mlx is a text generation model from nightmedia. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
The performance matrix of Qwen3-30B-A3B-Element7-1M
Downloads · 30 days
20
17% of all-time downloads
All-time downloads
116
Public
Parameters
30.5B
20.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors20.5 GB · 100%
How the weights are stored.
U3230.5B · 100%
From the Hugging Face model README
The performance matrix of Qwen3-30B-A3B-Element7-1M
mxfp4 0.560,0.711,0.876,0.738,0.454,0.802,0.659
qx64-hi 0.569,0.761,0.878,0.740,0.462,0.808,0.688
qx86-hi 0.578,0.750,0.883,0.742,0.478,0.804,0.684
Model quant size and Perplexity
mxfp4 16.24 GB 4.153 ± 0.025
qx64-hi 20.47 GB 3.993 ± 0.024
qx86-hi 28.10 GB 3.942 ± 0.024
Brainwaves for qx86-hi for Nightmedia elements
arc arc/e boolq hswag obkqa piqa wino
Element4 0.514,0.617,0.846,0.769,0.442,0.801,0.731
Element5 0.560,0.709,0.883,0.756,0.448,0.807,0.713
Element6 0.568,0.737,0.880,0.760,0.450,0.803,0.714
Element7 0.578,0.750,0.883,0.742,0.478,0.804,0.684
Assimilation complete--the DASD distinctiveness was added to our own.
Resistance is futile. Some wino got nicked, but what arc and logic!
And--yay!--more openbookqa, what joy!
High openbookqa in a MoE is like paying with latinum at Quark's: the Romulan Ale will be authentic, served just how you like it. And Quark would know it, and he would wink--a healthy premonition in good spirits is good for business.
At this point, counting only actual model traces there are eight distinct models in this merge; counting YOYO as distinct, we have 10, counting the number of folds necessary to stabilize the formula.. well, they are all different.
The Element number and the number of models in the merge are not related, it is simply the index in the lab series I started, and that my lab is relying more on research than blind testing. Earlier Elements are just as potent but not stable enough for release. Once merged in other models, those features are assimilated, and the perplexity weakness eliminated: now the model is confident about what it thinks it knows.
The Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview just came out, and by the looks of that Perplexity, no wonder it takes forever to put something together.
Model: DASD-30B-A3B-Thinking-Preview-qx86-hi-mlx
Perplexity: 7.861 ± 0.082
So I decided to embed it in the Qwen3-30B-A3B-Element6-1M that I just published.
models:
- model: nightmedia/Qwen3-30B-A3B-Element6-1M
parameters:
weight: 1.6
- model: Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview
parameters:
weight: 0.4
merge_method: nuslerp
tokenizer_source: base
dtype: bfloat16
name: nightmedia/Qwen3-30B-A3B-Element7-1M
So far, so good...
Model: Qwen3-30B-A3B-Element7-qx86-hi-mlx
Perplexity: 3.942 ± 0.024
Model: Qwen3-30B-A3B-Element7-qx64-hi-mlx
Perplexity: 3.993 ± 0.024
Model: Qwen3-30B-A3B-Element7-mxfp4-mlx
Perplexity: 4.153 ± 0.025
Well, there we go. Cut in half.
Looking on how it distances itself from baseline
DASD 0.462,0.529,0.840,0.636,0.406,0.766,0.596
baseline 0.410,0.444,0.691,0.635,0.390,0.769,0.650
Compared to other models, here's YOYO. One of the best AI labs on HuggingFace, that really put some thinking in those merges. I think for them nomen est omen which probably explains AutoThink.
Qwen3-30B-A3B-YOYO-V2
qx86-hi 0.531,0.690,0.885,0.685,0.448,0.785,0.646
Qwen3-30B-A3B-YOYO-V3
qx86-hi 0.472,0.550,0.880,0.698,0.442,0.789,0.650
Qwen3-30B-A3B-YOYO-V4
qx86-hi 0.511,0.674,0.885,0.649,0.442,0.769,0.618
Qwen3-30B-A3B-YOYO-V5
qx86-hi 0.511,0.669,0.885,0.653,0.440,0.772,0.619
Qwen3-30B-A3B-YOYO-AutoThink
qx86-hi 0.454,0.481,0.869,0.673,0.404,0.777,0.643
I use the YOYO-V2 and YOYO-V4 for their properties in the 30B Nightmedia models.
They merge the same Qwen3-30B-A3B Thinking/Coder/Instruct, and every time they do it better. Almost every time.
The YOYO models are impossible to beat in the 30B, as a straight merge. There is no training there, just merge tech, and they are pros.
What I do with Nightmedia is a bit different, I merge metaphors.
Really don't care what models go in there, and for me, nomen est omen:
Azure99/Blossom-V6.3-30B-A3B
GAIR/SR-Scientist-30B
NousResearch/nomos-1
YOYO-AI/Qwen3-30B-A3B-YOYO-V4/V2
miromind-ai/MiroThinker-v1.0-30B
Tongyi-Zhiwen/QwenLong-L1.5-30B-A3B
bgg1996/Melinoe-Qwen-30B-A3B-Afterthought
Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview
This is the lineage of Element:
Qwen3-30B-A3B-Element6-1M
qx86-hi 0.568,0.737,0.880,0.760,0.450,0.803,0.714
Qwen3-30B-A3B-Architect18
qx86-hi 0.577,0.760,0.879,0.760,0.446,0.803,0.702
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("Qwen3-30B-A3B-Element7-1M-qx64-hi-mlx")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True, return_dict=False,
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)