Downloads · 30 days
14
12% of all-time downloads
GaLLM-14B-v0.2-GPTQ-Int4
CjangCjengh/GaLLM-14B-v0.2-GPTQ-Int4
GaLLM-14B-v0.2-GPTQ-Int4 is a machine learning model from CjangCjengh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-sa-4.0.
All-time downloads
114
Public
Parameters
14.8B
10 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors10 GB · 100%
Parameter types
How the weights are stored.
I3213.2B · 89%
Base models
Model card
From the Hugging Face model README
GaLLM-14B-v0.2的GPTQ-Int4量化版，使用方法相同
推荐使用vllm部署，然后使用OpenAI格式的API访问：
vllm serve CjangCjengh/GaLLM-14B-v0.2-GPTQ-Int4 --port <your_port>
- Type
- qwen2
- License
- cc-by-nc-sa-4.0
- Languages
- ja, zh, ko
- Created
- Mar 17, 2025
- Updated
- Mar 17, 2025