Downloads · 30 days
311
1% of all-time downloads
AISquare-Instruct-llama2-koen-13b-v0.9.24
inswave/AISquare-Instruct-llama2-koen-13b-v0.9.24
AISquare-Instruct-llama2-koen-13b-v0.9.24 is a text generation model from inswave. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
Developed by Inswave Systems UI Platform Team
All-time downloads
53.7K
Public
Parameters
13.2B
26.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors26.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- llama
- Access
- Public
- Created
- Dec 18, 2023
- Updated
- Jan 10, 2024
- SHA
- 0302553f
Try a prompt
Model card
From the Hugging Face model README
AISquare-Instruct-llama2-koen-13b-v0.9.24
Model Details
Developed by Inswave Systems UI Platform Team
Method
Using DPO method and SFT method
Hardware
We utilized an A100x4 * 1 for training our model
Base Model beomi/llama2-koen-13b
Implementation Code
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
repo = "inswave/AISquare-Instruct-llama2-koen-13b-v0.9.24"
model = AutoModelForCausalLM.from_pretrained(
repo,
return_dict=True,
torch_dtype=torch.float16,
device_map='auto'
)
tokenizer = AutoTokenizer.from_pretrained(repo)
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- cc-by-nc-4.0
- Languages
- en
- Created
- Dec 18, 2023
- Updated
- Jan 10, 2024