Downloads · 30 days
6
10% of all-time downloads
IBDPLab/EXAONE-4.0-1.2B-W4A16-GPTQ
EXAONE-4.0-1.2B-W4A16-GPTQ is a machine learning model from IBDPLab. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
- Base Model: LGAI-EXAONE/EXAONE-4.0-1.2B - Method: GPTQ W4A16 - Group Size: 128 - Calibration Dataset: LGAI-EXAONE/MANTA-1M (512 samples) - Tool: llmcompressor
Downloads · 30 days
6
10% of all-time downloads
All-time downloads
62
Public
Parameters
1.5B
1.4 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors1.4 GB · 99%
How the weights are stored.
I321.1B · 71%
From the Hugging Face model README
from vllm import LLM
llm = LLM(model="IBDPLab/EXAONE-4.0-1.2B-W4A16-GPTQ")