Downloads · 30 days
119
0% of all-time downloads
K-Compression/HyperCLOVAX-SEED-Think-14B-GPTQ
HyperCLOVAX-SEED-Think-14B-GPTQ is a text generation model from K-Compression. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This repo contains GPTQ model files for HyperCLOVAX-SEED-Think-14B.
Downloads · 30 days
119
0% of all-time downloads
All-time downloads
1.1M
Public
Parameters
14.7B
9.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors9.7 GB · 100%
How the weights are stored.
I3213.4B · 91%
From the Hugging Face model README
This repo contains GPTQ model files for HyperCLOVAX-SEED-Think-14B.
HyperCLOVAX-SEED-Think-14B-GPTQ was quantized using gptqmodel v4.0.0, following the guide.
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "K-Compression/HyperCLOVAX-SEED-Think-14B-GPTQ"
model = AutoModelForCausalLM.from_pretrained(
model_name,
torch_dtype="bfloat16",
device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained(model_name)
| Model | MMLU (0-shot) | HAERAE (0-shot) |
|---|---|---|
| HyperCLOVA X SEED 14B Think | 0.7144 | 0.8130 |
| HyperCLOVA X SEED 14B Think-GPTQ | 0.7018 | 0.8139 |
The model is licensed under HyperCLOVA X SEED Model License Agreement