Downloads · 30 days
55
0% of all-time downloads
SVD-Qwen3-Coder-Next-Thinking-AWQ-4bit
cyankiwi/SVD-Qwen3-Coder-Next-Thinking-AWQ-4bit
SVD-Qwen3-Coder-Next-Thinking-AWQ-4bit is a text generation model from cyankiwi. Use it when you need the model to write or continue text. It is set up for transformers.
<div align="left" <a href="https://cyan.kiwi" target="blank"<img src="https://storage.googleapis.com/cyankiwi-assets/model-card/model-card-banners-cyankiwi.png" width="800" alt="cyankiwi, the LLM inference agent for o…
All-time downloads
11.8K
Public
Parameters
14.4B
48.3 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors48.2 GB · 100%
Parameter types
How the weights are stored.
I3277.3B · 97%
Try a prompt
Base models
Model card
From the Hugging Face model README
<div align="left">
<a href="https://cyan.kiwi" target="_blank"><img src="https://storage.googleapis.com/cyankiwi-assets/model-card/model-card-banners-cyankiwi.png" width="800" alt="cyankiwi, the LLM inference agent for open models"></a>
</div>
<div align="left">
<table style="border-collapse:collapse; border:none;">
<tr style="border:none;">
<td align="left" style="border:none; padding:4px 24px 4px 0;"><b>Website</b></td>
<td align="left" style="border:none; padding:4px 0;"><a href="https://cyan.kiwi/" target="_blank">cyan.kiwi</a></td>
</tr>
<tr style="border:none;">
<td align="left" style="border:none; padding:4px 24px 4px 0;"><b>Models</b></td>
<td align="left" style="border:none; padding:4px 0;"><a href="https://huggingface.co/cyankiwi" target="_blank">Hugging Face</a> · <a href="https://www.modelscope.ai/organization/cyankiwi" target="_blank">ModelScope</a></td>
</tr>
<tr style="border:none;">
<td align="left" style="border:none; padding:4px 24px 4px 0;"><b>Connect</b></td>
<td align="left" style="border:none; padding:4px 0;"><a href="https://x.com/cyankiwi_ai" target="_blank">X</a> · <a href="https://www.reddit.com/r/cyankiwi/" target="_blank">Reddit</a> · <a href="mailto:[email protected]">Email</a></td>
</tr>
</table>
</div>
<br>
<div align="left">
<img src="https://storage.googleapis.com/cyankiwi-assets/model-card/model-card-banners-awq.png" width="800" alt="cyankiwi Activation-aware Weight Quantization">
</div>
<div align="left">
<table style="border-collapse:collapse; border:none;">
<tr style="border:none;">
<td align="left" style="border:none; padding:4px 24px 4px 0;"><b>Version</b></td>
<td align="left" style="border:none; padding:4px 0;"><a href="https://github.com/vllm-project/llm-compressor" target="_blank">llm-compressor</a></td>
</tr>
<tr style="border:none;">
<td align="left" style="border:none; padding:4px 24px 4px 0;"><b>Calibration</b></td>
<td align="left" style="border:none; padding:4px 0;"><a href="https://huggingface.co/datasets/nvidia/Llama-Nemotron-Post-Training-Dataset" target="_blank">nvidia/Llama-Nemotron-Post-Training-Dataset</a></td>
</tr>
<tr style="border:none;">
<td align="left" style="border:none; padding:4px 24px 4px 0;"><b>Model Size</b></td>
<td align="left" style="border:none; padding:4px 0;">48.25 GB</td>
</tr>
</table>
</div>
<br>
<p align="left">
<a href="https://cyan.kiwi/workspace?prompt=Deploy%20cyankiwi/SVD-Qwen3-Coder-Next-Thinking-AWQ-4bit" target="_blank"><img src="https://storage.googleapis.com/cyankiwi-assets/model-card/model-card-button-deploy.png" width="333" alt="Deploy on cyan.kiwi private endpoints"></a>
</p>
Qwen-3-next-coder-arcee_fusion
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the Arcee Fusion merge method using F:\Huihui-Qwen3-Coder-Next-abliterated as a base.
Models Merged
The following models were included in the merge:
- F:\Huihui-Qwen3-Next-80B-A3B-Thinking-abliterated
Configuration
The following YAML configuration was used to produce this model:
models:
- model: F:\Huihui-Qwen3-Next-80B-A3B-Thinking-abliterated
- model: F:\Huihui-Qwen3-Coder-Next-abliterated
merge_method: arcee_fusion
base_model: F:\Huihui-Qwen3-Coder-Next-abliterated
dtype: bfloat16
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3_next
- Created
- Mar 9, 2026
- Updated
- Oct 19, 2026