Downloads · 30 days
11
12% of all-time downloads
EXAONE-4.0-1.2B-W4A16-GPTQ-FP8KV
IBDPLab/EXAONE-4.0-1.2B-W4A16-GPTQ-FP8KV
EXAONE-4.0-1.2B-W4A16-GPTQ-FP8KV is a machine learning model from IBDPLab. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
- Base Model: LGAI-EXAONE/EXAONE-4.0-1.2B - Method: GPTQ W4A16 - Group Size: 128 - Activation Order: group - Dampening: 0.01 - Calibration Dataset: LGAI-EXAONE/MANTA-1M (512 samples, maxseqlen=2048) - KV Cache: FP8 (c…
All-time downloads
89
Public
Parameters
1.5B
1.4 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors1.4 GB · 99%
Parameter types
How the weights are stored.
I321.1B · 71%
Model card
From the Hugging Face model README
Quantization Details
- Base Model: LGAI-EXAONE/EXAONE-4.0-1.2B
- Method: GPTQ W4A16
- Group Size: 128
- Activation Order: group
- Dampening: 0.01
- Calibration Dataset: LGAI-EXAONE/MANTA-1M (512 samples, max_seq_len=2048)
- KV Cache: FP8 (config.json에 kv_cache_scheme 포함)
- Tool: llmcompressor (GPTQModifier)
Usage
from vllm import LLM
llm = LLM(model="IBDPLab/EXAONE-4.0-1.2B-W4A16-GPTQ-FP8KV")
- Type
- exaone4
- License
- other
- Created
- Apr 7, 2026
- Updated
- Apr 7, 2026