Downloads · 30 days
14
8% of all-time downloads
Qwen-3-150B
Delta-Vector/Qwen-3-150B
Qwen-3-150B is a text generation model from Delta-Vector. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Same methodology as Kalomaze's 16B experiment : https://huggingface.co/kalomaze/Qwen3-16B-A3B/
All-time downloads
171
Public
Parameters
150B
300 GB on disk
Likes
5
Public
Repo makeup
Click a slice to open those files.
.safetensors300 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3_moe
- Access
- Public
- Created
- May 2, 2025
- Updated
- May 3, 2025
- SHA
- 7199e311
Try a prompt
Base models
Model card
From the Hugging Face model README
Same methodology as Kalomaze's 16B experiment : https://huggingface.co/kalomaze/Qwen3-16B-A3B/
- measure the probability that any given expert will activate (over a personal set of fairly diverse calibration data), per layer
- prune some of the least used experts per layer (with reordered router and indexing per layer)
Currently it is unusable but i am working on training it over a small SFT of claude Instruct data to "heal" it per say.
https://wandb.ai/new-eden/Prune-Experiments/runs/45utvk5c?nw=nwuserdeltavector
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3_moe
- License
- apache-2.0
- Created
- May 2, 2025
- Updated
- May 3, 2025