Qwen3-VL-8B-Instruct-exl3

EXL3 quants of Qwen3-VL-8B-Instruct

⚠️ Requires ExLlamaV3 v0.0.13 (or v0.0.12 dev branch)

2.00 bits per weight
2.25 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight

KL divergence

SVG Catbench

<table> <tr> <td align="center"> <a href="https://huggingface.co/turboderp/Qwen3-VL-8B-Instruct-exl3/blob/main/2.0bpw.svg"> <img src="2.0bpw.svg" alt="2.00 bpw" width="160"> </a> <div>2.00 bpw</div> </td> <td align="center"> <a href="https://huggingface.co/turboderp/Qwen3-VL-8B-Instruct-exl3/blob/main/2.25bpw.svg"> <img src="2.25bpw.svg" alt="2.25 bpw" width="160"> </a> <div>2.25 bpw</div> </td> <td align="center"> <a href="https://huggingface.co/turboderp/Qwen3-VL-8B-Instruct-exl3/blob/main/2.5bpw.svg"> <img src="2.5bpw.svg" alt="2.5 bpw" width="160"> </a> <div>2.5 bpw</div> </td> <td align="center"> <a href="https://huggingface.co/turboderp/Qwen3-VL-8B-Instruct-exl3/blob/main/3.0bpw.svg"> <img src="3.0bpw.svg" alt="3.00 bpw" width="160"> </a> <div>3.00 bpw</div> </td> </tr> <tr> <td align="center"> <a href="https://huggingface.co/turboderp/Qwen3-VL-8B-Instruct-exl3/blob/main/3.5bpw.svg"> <img src="3.5bpw.svg" alt="3.50 bpw" width="160"> </a> <div>3.50 bpw</div> </td> <td align="center"> <a href="https://huggingface.co/turboderp/Qwen3-VL-8B-Instruct-exl3/blob/main/4.0bpw.svg"> <img src="4.0bpw.svg" alt="4.00 bpw" width="160"> </a> <div>4.00 bpw</div> </td> <td align="center"> <a href="https://huggingface.co/turboderp/Qwen3-VL-8B-Instruct-exl3/blob/main/5.0bpw.svg"> <img src="5.0bpw.svg" alt="5.00 bpw" width="160"> </a> <div>5.00 bpw</div> </td> <td align="center"> <a href="https://huggingface.co/turboderp/Qwen3-VL-8B-Instruct-exl3/blob/main/6.0bpw.svg"> <img src="6.0bpw.svg" alt="6.00 bpw" width="160"> </a> <div>6.00 bpw</div> </td> </tr> <tr> <td align="center"> <a href="https://huggingface.co/turboderp/Qwen3-VL-8B-Instruct-exl3/blob/main/api.svg"> <img src="api.svg" alt="API" width="160"> </a> <div>API</div> </td> </tr> </table>

Image captioning

<details> <summary><b>2.0bpw</b></summary> This adorable image features a tiny kitten with a soft, fluffy coat of brown, gray, and white stripes. The kitten is wearing a colorful, handcrafted crocheted party hat that’s rainbow-striped (blue, purple, green, yellow, orange) with a pink pom-pom on top. The hat sits snugly on its head, adding a whimsical touch.

The kitten has large, dark, expressive eyes that look directly at the camera, giving it a curious and sweet expression. It’s standing on a soft blanket with a pattern of green and white shapes, likely a cozy blanket or bedspread. The background is softly blurred, showing a home interior with furniture and decor, keeping the focus on the adorable kitten.

Overall, the image captures a moment of innocence and charm, highlighting the kitten’s adorable appearance and the playful hat. It’s a heartwarming, cute snapshot perfect for sharing.

</details> <details> <summary><b>2.25bpw</b></summary> This is a charming and adorable photograph of a very young kitten. The kitten has soft, fluffy fur with a tabby pattern—striped markings on its face and body, with a mix of brown, gray, and white colors. Its large, dark eyes are wide and expressive, giving it an innocent and curious look.

The kitten is wearing a small, handmade, rainbow-colored knitted party hat. The hat features vibrant stripes of blue, purple, green, yellow, and orange, topped with a bright pink pom-pom. The base of the hat is white and looks like a soft, fluffy cloud or a cupcake, adding to the whimsical appearance.

The kitten is standing on a colorful, patterned blanket—likely a soft, cozy blanket with green, white, and beige hues. The background is softly blurred, suggesting an indoor setting, with furniture and decor visible.

Overall, the image captures a sweet, playful moment, highlighting the cuteness of the kitten and the delightful accessory it wears. It’s a heartwarming and joyful scene.

</details> <details> <summary><b>2.5bpw</b></summary> This is an adorable, close-up photograph of a very young tabby kitten wearing a colorful, hand-knit party hat.

The kitten has big, dark, expressive eyes and a soft, fluffy coat with classic tabby stripes. It's standing on a patterned blanket that features green, white, and other colors, possibly a floral or animal print design. The hat is the focal point — it's a tiny, multi-colored knit cap with a rainbow pattern (blue, purple, green, orange, and yellow), topped with a pink pom-pom. The base of the hat is white, resembling the frosting on a cupcake.

The kitten appears to be looking directly at the camera, giving the image a sweet, endearing quality. The background is softly blurred, keeping the focus on the kitten and its charming hat. The lighting is warm and gentle, highlighting the kitten's features and the texture of the hat.

Overall, this is a heartwarming image capturing the innocence and charm of a tiny kitten celebrating a special occasion.

</details> <details> <summary><b>3.0bpw</b></summary> This is an adorable, close-up photograph of a very small tabby kitten wearing a colorful, hand-knit party hat.

Here are the key details:

• The Kitten: The kitten is tiny, likely only a few weeks old, with soft gray and brown tabby markings. Its large, dark, round eyes are wide open, giving it a curious and innocent expression. It has long, delicate white whiskers. A small white tag or collar is visible around its neck.
• The Hat: The kitten is wearing a charming, knitted party hat. The hat is made of rainbow-colored stripes (blue, purple, green, yellow, orange) and has a fluffy white pom-pom at the base and a pink pom-pom on top. The hat fits snugly on its head.
• The Setting: The kitten is standing on a soft, fuzzy blanket with a green and white pattern, possibly featuring animal shapes. The background is softly blurred, suggesting an indoor home environment.

The overall image is heartwarming and charming, capturing a sweet moment of a young kitten dressed up for a celebration.

</details> <details> <summary><b>3.5bpw</b></summary> This is an adorable close-up photograph of a very young tabby kitten.

The kitten is the main focus, looking directly at the camera with large, dark, curious eyes. It has a small, striped coat of grey and brown tabby markings, with a white patch on its chest and paws. A small white collar is visible around its neck.

The most charming feature is the tiny, hand-knitted party hat perched perfectly on its head. The hat is colorful, featuring stripes of rainbow colors (pink, blue, purple, green, yellow, orange) and a white, fluffy brim. The top of the hat is adorned with a small, fuzzy pink pom-pom.

The kitten is standing on a soft, textured blanket with a green and white pattern, possibly with some animal motifs. The background is softly blurred, suggesting an indoor setting with some furniture or decor visible.

The overall image is heartwarming and playful, capturing a sweet moment of a tiny kitten dressed up for a celebration.

</details> <details> <summary><b>4.0bpw</b></summary> This is an adorable, close-up photograph of a very small kitten, likely just a few weeks old.

The kitten has a soft, fluffy coat with a mix of grey, brown, and white fur, and distinct tabby markings. Its most striking features are its large, wide, dark eyes that gaze directly at the camera with a curious and slightly innocent expression. Long, delicate whiskers extend from its face.

The kitten is wearing a charming, hand-knitted party hat. The hat is colorful, featuring stripes in the rainbow pattern (blue, purple, green, yellow, orange) and a fluffy white pom-pom at the base, topped with a bright pink pom-pom. A small white tag or collar is visible around its neck.

It is standing on a soft, textured blanket with a green and white pattern. The background is softly blurred, suggesting an indoor setting with furniture.

Overall, the image captures a sweet and endearing moment, highlighting the kitten's youthful cuteness and the playful, festive touch of the hat.

</details> <details> <summary><b>5.0bpw</b></summary> This is an adorable close-up photograph of a very young tabby kitten, looking directly at the camera with large, expressive dark eyes.

The kitten is wearing a charming, hand-knitted party hat. The hat is colorful, featuring rainbow stripes in blue, purple, green, yellow, and orange, topped with a fluffy white pom-pom and a small pink tuft at the very peak. The kitten's fur is a mix of gray, brown, and white, with classic tabby markings on its face and body. It has long, delicate white whiskers.

The kitten is standing on a soft, patterned blanket with green and cream colors. A small white collar or tag is visible around its neck. The background is softly blurred, suggesting a cozy indoor setting with some furniture and possibly a plant.

The overall image is heartwarming and playful, capturing the sweet innocence of a tiny kitten dressed up for a celebration.

</details> <details> <summary><b>6.0bpw</b></summary> This is an adorable, close-up photograph of a very young tabby kitten wearing a colorful, hand-knitted party hat.

Key Features:

• The Kitten: The kitten has wide, dark, curious eyes and soft, striped fur in shades of grey, brown, and white. Its ears are perked up, and it's looking directly at the camera with an innocent, slightly bewildered expression. It appears to be standing on a soft, patterned blanket.
• The Hat: The most striking element is the tiny, hand-knitted party hat perched perfectly on its head. The hat is multi-colored, featuring stripes of blue, purple, green, yellow, and orange, topped with a small, fluffy pink pom-pom. The brim of the hat is white, and a small white knitted bell hangs down from the front.
• The Setting: The kitten is positioned on a green and white patterned blanket or rug. The background is softly blurred, suggesting an indoor home environment.

The overall image is very cute and heartwarming, capturing a sweet, candid moment of a tiny kitten in a festive outfit.

</details>