Downloads · 30 days
7
1% of all-time downloads
iolai-qwen35-solver
ajinkyamulay/iolai-qwen35-solver
iolai-qwen35-solver is a text generation model from ajinkyamulay. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
INT4 weight-only quantization of Qwen/Qwen3.5-9B.
All-time downloads
634
Public
Parameters
9B
7.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors7.6 GB · 99%
Parameter types
How the weights are stored.
I326.9B · 77%
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.5-9B-AWQ-INT4
INT4 weight-only quantization of Qwen/Qwen3.5-9B.
Qwen 3.5 9B in INT4. Coordinated drawais kit.
| Property | Value |
|---|---|
| Base model | Qwen/Qwen3.5-9B |
| Quantization | INT4 weight-only |
| Approx. on-disk size | ~7.7 GB |
| License | Apache License, Version 2.0 |
| Languages | English |
Load (vLLM)
vllm serve drawais/Qwen3.5-9B-AWQ-INT4 \
--max-model-len 32768 \
--gpu-memory-utilization 0.94
from vllm import LLM, SamplingParams
llm = LLM(model="drawais/Qwen3.5-9B-AWQ-INT4", max_model_len=32768)
print(llm.generate(["Hello!"], SamplingParams(max_tokens=128))[0].outputs[0].text)
Footprint
~7.7 GB on disk. Recommended VRAM: enough headroom for KV cache.
License & attribution
This artifact is a derivative work of Qwen/Qwen3.5-9B,
released by its original authors under the Apache License, Version 2.0.
This artifact is distributed under the same license. The full license text is
included in LICENSE, and required attribution is in NOTICE.
License text: https://www.apache.org/licenses/LICENSE-2.0 Source model: https://huggingface.co/Qwen/Qwen3.5-9B
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3_5_text
- License
- apache-2.0
- Languages
- en
- Created
- Jul 10, 2026
- Updated
- Jul 12, 2026