Qwen3-Next-80B-A3B-Instruct-gguf

Qwen3 Next Instruct gguf

Make sure you have enough memory/GPU

Use the model in ollama

First download and install ollama.

https://ollama.com/download

Note: the official ollama models do not have Qwen3-Next support yet. You need do the following.

Command

in windows command line (or mac os, linux), or in terminal in ubuntu, type:

ollama run hf.co/John1604/Qwen3-Next-80B-A3B-Instruct-gguf:q3_k_m

(q3_k_m is the model quant type, q3_k_s, q4_k_m, ..., can also be used)

C:\Users\developer>ollama run hf.co/John1604/Qwen3-Next-80B-A3B-Instruct-gguf:q3_k_m
pulling manifest
...
writing manifest
success

>>> Send a message (/? for help) 

After you run command: ollama run hf.co/John1604/Qwen3-Next-80B-A3B-Instruct-gguf:q3_k_m, it will appear in ollama UI - you may select this model hf.co/John1604/Qwen3-Next-80B-A3B-Instruct-gguf:q3_k_m from the model list, and run it the same way as other ollama supported models.

Use the model in LM Studio

download and install LM Studio

https://lmstudio.ai/

Discover models

In the LM Studio, click "Discover" icon. "Mission Control" popup window will be displayed.

In the "Mission Control" search bar, type "John1604/Qwen3-Next-80B-A3B-Instruct-gguf" and check "GGUF", the model should be found.

Download a quantized model.

Load the quantized model.

Ask questions.

quantized models