Downloads · 30 days
16
18% of all-time downloads
EXAONE-3.5-7.8B-s1.1-Ko-Native
werty1248/EXAONE-3.5-7.8B-s1.1-Ko-Native
EXAONE-3.5-7.8B-s1.1-Ko-Native is a text generation model from werty1248. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
91
Public
Parameters
7.8B
15.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors15.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Feb 24, 2025
- Updated
- Feb 26, 2025
- SHA
- bc02efc2
Try a prompt
Model card
From the Hugging Face model README
- 실행 결과: werty1248/s1.1-Ko-Native-result
- werty1248/EXAONE-3.5-7.8B-s1-Ko-no-sample-packing 보단 낫지만, 오리지널 모델과 점수 차이 거의 없음
Training Details
- 공식 학습 코드 사용
- 8xA40, 2.5 hours
- Total batch size: 16 -> 8
- block_size=16384
- gradient_checkpointing=True
Others
- VRAM 아슬아슬 (block_size=20000, gradient_accumulation_steps=2 전부 CUDA OOM)
- 고질적인 "한 번 잘못 생각하면 잠깐만요 해놓고도 계속 같은 실수를 반복하는 현상"이 해결이 안됨
- EXAONE의 특성 or 소형모델의 특성 or
번역 데이터의 특성
- EXAONE의 특성 or 소형모델의 특성 or
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Feb 24, 2025
- Updated
- Feb 26, 2025