kaitchup

Qwen3-4B-Instruct-2507-awq-w4a16-asym

kaitchup/Qwen3-4B-Instruct-2507-awq-w4a16-asym

Qwen3-4B-Instruct-2507-awq-w4a16-asym is a machine learning model from kaitchup. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

This is Qwen/Qwen3-4B-Instruct-2507 quantized with LLM Compressor with AWQ W4A16. The model has been created, tested, and evaluated by The Kaitchup. The model is compatible with vLLM v0.11. Tested with an RTX 5090.