Downloads · 30 days
8
3% of all-time downloads
fastllm/Qwen3-Next-80B-A3B-Instruct-UD-Q4_K_M
Qwen3-Next-80B-A3B-Instruct-UD-Q4_K_M is a machine learning model from fastllm. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
8
3% of all-time downloads
All-time downloads
308
Public
Parameters
81.3B
49.9 GB on disk
Likes
4
Public
Click a slice to open those files.
.safetensors49.9 GB · 100%
How the weights are stored.
fastllm78.9B · 97%
From the Hugging Face model README
https://github.com/ztxz16/fastllm
# (you should install cuda12 first)
pip install ftllm -U
pip install https://www.modelscope.cn/models/huangyuyang/fastllmdepend-windows/resolve/master/ftllmdepend-0.0.0.1-py3-none-win_amd64.whl
pip install ftllm -U
ftllm chat YOUR_MODEL_PATH # chat
ftllm webui YOUR_MODEL_PATH # webui
ftllm server YOUR_MODEL_PATH # server