kaitchup

Qwen3-4B-Thinking-2507-fp8-dynamic

kaitchup/Qwen3-4B-Thinking-2507-fp8-dynamic

Qwen3-4B-Thinking-2507-fp8-dynamic is a machine learning model from kaitchup. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

This is Qwen/Qwen3-4B-Thinking-2507 quantized with LLM Compressor with FP8 W8A8. The model has been created, tested, and evaluated by The Kaitchup. The model is compatible with vLLM v0.11. Tested with an RTX 5090.