Skip to content

yapwithai

jeffcookio-mistral-small-3.2-24B-instruct-2506-awq-sym

yapwithai/jeffcookio-mistral-small-3.2-24B-instruct-2506-awq-sym

jeffcookio-mistral-small-3.2-24B-instruct-2506-awq-sym is a machine learning model from yapwithai. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Created with llm-compressor's latest changes, quantized on a GH200, works well for me with vLLM's main branch on my RTX 3090Ti as of 2025-07-01.

Downloads · 30 days

12

13% of all-time downloads

All-time downloads

90

Public

Parameters

24.2B

20 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors15 GB · 100%

Parameter types

How the weights are stored.

I3222.2B · 92%

Base models

Type
mistral3
Created
Dec 14, 2025
Updated
Jul 4, 2025