Downloads · 30 days
10
0% of all-time downloads
AISquare-Instruct-yi-ko-6b-v0.9.30
zomd/AISquare-Instruct-yi-ko-6b-v0.9.30
AISquare-Instruct-yi-ko-6b-v0.9.30 is a text generation model from zomd. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
Developed by Inswave Systems UI Platform Team
All-time downloads
61.1K
Public
Parameters
6.2B
12.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors12.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- llama
- Access
- Public
- Created
- Dec 21, 2023
- Updated
- Feb 2, 2024
- SHA
- 891a9487
Try a prompt
Model card
From the Hugging Face model README
AISquare-Instruct-yi-ko-6b-v0.9.30
Model Details
Developed by Inswave Systems UI Platform Team
Method
Using DPO method and SFT method
Hardware
We utilized an A100x4 * 1 for training our model
Base Model beomi/Yi-Ko-6B
Open ko-leaderboard Rank
<img src='./ko-leaderboard.png' width=512>Implementation Code
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
repo = "zomd/AISquare-Instruct-yi-ko-6b-v0.9.30"
model = AutoModelForCausalLM.from_pretrained(
repo,
return_dict=True,
torch_dtype=torch.float16,
device_map='auto'
)
tokenizer = AutoTokenizer.from_pretrained(repo)
이 연구는 인공지능산업융합사업단(AICA)에서 추진한 『인공지능 중심 산업융합 집적단지 조성사업』 의 지원을 받아 진행된 결과입니다.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- cc-by-nc-4.0
- Languages
- en
- Created
- Dec 21, 2023
- Updated
- Feb 2, 2024