Downloads · 30 days
8
14% of all-time downloads
EXAONE3-IT8k-llamafy-awq
lee5j/EXAONE3-IT8k-llamafy-awq
EXAONE3-IT8k-llamafy-awq is a text generation model from lee5j. Use it when you need the model to write or continue text.
LG AI EXAONE3 - llamafy + 8K Context length - 4bit awq quantized model
All-time downloads
57
Public
Parameters
7.8B
5.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.3 GB · 100%
Parameter types
How the weights are stored.
I327B · 89%
Try a prompt
Base models
Model card
From the Hugging Face model README
LG AI EXAONE3 -> llamafy + 8K Context length -> 4bit awq quantized model
tested in vllm, just for use
''' vllm serve lee5j/EXAONE3-IT8k-llamafy-awq --enforce-eager --gpu-memory-utilization 0.99 '''
Lincense : https://huggingface.co/LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct/blob/main/LICENSE
origin model : LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct
- Task
- Text Generation
- Type
- llama
- Languages
- en, ko
- Created
- Oct 2, 2024
- Updated
- Oct 6, 2024