Downloads · 30 days
208
17% of all-time downloads
jamesbrunet/Swift-Qwen3.8-27b-W4A16-AutoRound
Swift-Qwen3.8-27b-W4A16-AutoRound is a image-text-to-text model from jamesbrunet. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as other.
Quantized ukisai/Swift-Qwen3.8-27b with Intel AutoRound and tested in vLLM. It appears to work!
Downloads · 30 days
208
17% of all-time downloads
All-time downloads
1.2K
Public
Parameters
6.3B
19.5 GB on disk
Likes
6
Public
Click a slice to open those files.
.safetensors19.5 GB · 100%
How the weights are stored.
I3224.3B · 88%
From the Hugging Face model README
Quantized ukisai/Swift-Qwen3.8-27b with Intel AutoRound and tested in vLLM. It appears to work!
Copied the work of dbirks/Qwen3.8-27B-W4A16-AutoRound except with embedding unquantized.
Base model distributed under UkisAI's Swift Open License v1.0. This quantization probably inherits those terms, but I'm not a lawyer.