Downloads · 30 days
28
5% of all-time downloads
walrus-gemma-2-9b-it-v02
aiyets/walrus-gemma-2-9b-it-v02
walrus-gemma-2-9b-it-v02 is a text generation model from aiyets. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as gemma.
All-time downloads
522
Public
Parameters
9.2B
18.5 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors18.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- gemma
- Model type
- gemma2
- Access
- Public
- Created
- Oct 23, 2024
- Updated
- Nov 6, 2024
- SHA
- f67acb02
Base models
Model card
From the Hugging Face model README
Model Card for Model ID
walrus 는 aiyets의 한국어 모델 미세조정 프로젝트입니다.
gemma-2-9b-it 모델이 기본적으로 한국어를 잘하는 편이기 때문에 미세조정 대상으로 선정했습니다.
Model Details
Model Description
How to Get Started with the Model
Use the code below to get started with the model.
Evaluation
- LogicKor. we evaluated by gpt-4o.
- custormized LogicKor. (support gemma, adding convenience features)
Testing Data, Factors & Metrics
Testing Data
Results
LogicKor
| 모델 | 글쓰기(Writing) | 문법(Grammar) | 수학(Math) | 이해(Understanding) | 추론(Reasoning) | 코딩(Coding) | Single turn | Multi turn | Overall |
|---|---|---|---|---|---|---|---|---|---|
| gemma-2-9b-it | 9.14, 9.14 | 6.71, 4.86 | 8.57, 8.43 | 8.43, 8.29 | 8.71, 7.29 | 9.29, 9.43 | 8.43 | 7.90 | 8.19 |
| walrus-gemma-2-9b-it-v02 | 9.29, 9.43 | 7.29, 5.00 | 7.86, 6.43 | 10.00, 9.57 | 9.00, 7.29 | 9.71, 10.00 | 8.86 | 7.95 | 8.40 |
| walrus-gemma-2-9b-it-v01 | 9.14, 9.00 | 7.14, 5.71 | 8.71, 8.00 | 9.86, 9.57 | 8.43, 7.29 | 9.00, 9.43 | 8.71 | 8.17 | 8.44 |
Summary
Version history
2024-10-23: v02 version (fix bad eos, 1 epoch -> 2 epoch)2024-10-17: first version (known issue: bad eos settings)
Contact
- Task
- Text Generation
- Library
- transformers
- Type
- gemma2
- License
- gemma
- Languages
- ko
- Created
- Oct 23, 2024
- Updated
- Nov 6, 2024