Downloads · 30 days
5
1% of all-time downloads
yeji-8b-rslora-v7-AWQ
tellang/yeji-8b-rslora-v7-AWQ
yeji-8b-rslora-v7-AWQ is a text generation model from tellang. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
436
Public
Parameters
2.2B
6.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors6.1 GB · 100%
Parameter types
How the weights are stored.
I326.9B · 84%
Base models
Model card
From the Hugging Face model README
YEJI-8B-RSLoRA-v7-AWQ
yeji-8b-rslora-v7의 AWQ 4-bit 양자화 버전.
Model Description
YEJI 8B 주력 모델의 AWQ 양자화 버전입니다. 원본 8.2B 파라미터를 4-bit로 양자화하여 GPU 메모리 사용량을 대폭 줄이고 vLLM 서빙에 최적화했습니다.
- Original Model: tellang/yeji-8b-rslora-v7
- Quantization: AWQ 4-bit (group_size=128)
- Optimized for: vLLM, TGI
Usage
vLLM (권장)
python -m vllm.entrypoints.openai.api_server \
--model tellang/yeji-8b-rslora-v7-AWQ \
--quantization awq \
--max-model-len 4096
Transformers
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained(
"tellang/yeji-8b-rslora-v7-AWQ",
torch_dtype="auto",
device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained("tellang/yeji-8b-rslora-v7-AWQ")
All YEJI Models
| Model | Params | Type | Downloads |
|---|---|---|---|
| yeji-8b-rslora-v7 | 8.2B | Full | 345 |
| yeji-8b-rslora-v7-AWQ | ~2.5B | AWQ 4-bit | 371 |
| yeji-4b-instruct-v9 | 4.0B | Full | 65 |
| yeji-4b-instruct-v9-AWQ | ~1.3B | AWQ 4-bit | 138 |
Limitations
- 한국어 운세/점술 도메인 특화. AWQ 양자화로 원본 대비 미세한 품질 저하 가능.
- 점술 결과는 엔터테인먼트 목적입니다.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3
- License
- apache-2.0
- Languages
- ko
- Created
- Jan 26, 2026
- Updated
- Mar 8, 2026