Downloads · 30 days
18
2% of all-time downloads
Synatra-kiqu-7B
maywell/Synatra-kiqu-7B
Synatra-kiqu-7B is a text generation model from maywell. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-sa-4.0.
All-time downloads
946
Public
Parameters
7.2B
14.5 GB on disk
Likes
5
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-sa-4.0
- Model type
- mistral
- Access
- Public
- Created
- Mar 5, 2024
- Updated
- Mar 6, 2024
- SHA
- 30c593b1
Try a prompt
Model card
From the Hugging Face model README
Join our discord
License
cc-by-sa-4.0
Model Details
Base Model
maywell/Synatra-7B-v0.3-dpo
Trained On
A100 80GB * 8
Sionic AI에서 GPU 자원을 지원받아 제작되었습니다.
Instruction format
It follows ChatML format.
Model Benchmark
TBD
Implementation Code
Since, chat_template already contains insturction format above. You can use the code below.
from transformers import AutoModelForCausalLM, AutoTokenizer
device = "cuda" # the device to load the model onto
model = AutoModelForCausalLM.from_pretrained("maywell/Synatra-kiqu-7B")
tokenizer = AutoTokenizer.from_pretrained("maywell/Synatra-kiqu-7B")
messages = [
{"role": "user", "content": "사회적 합의는 어떤 맥락에서 사용되는 말이야?"},
]
encodeds = tokenizer.apply_chat_template(messages, return_tensors="pt")
model_inputs = encodeds.to(device)
model.to(device)
generated_ids = model.generate(model_inputs, max_new_tokens=1000, do_sample=True)
decoded = tokenizer.batch_decode(generated_ids)
print(decoded[0])
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- cc-by-sa-4.0
- Created
- Mar 5, 2024
- Updated
- Mar 6, 2024