Downloads · 30 days
8
12% of all-time downloads
AIdenU/LLAMA-2-13b-ko-Y24_v0.1
LLAMA-2-13b-ko-Y24_v0.1 is a text generation model from AIdenU. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
8
12% of all-time downloads
All-time downloads
67
Public
Repo size
26 GB
Likes
0
Public
Click a slice to open those files.
.bin26 GB · 100%
From the Hugging Face model README
from transforemrs import AutoTokenizer, AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("AIdenU/LLAMA-2-13b-ko-Y24_v0.1", device_map="auto")
tokenizer = AutoTokenizer.from_pretrained("AIdenU/LLAMA-2-13b-ko-Y24_v0.1", use_fast=True)
text="안녕하세요."
outputs = model.generate(
**tokenizer(
f"### Instruction: {text}\n\n### output:",
return_tensors='pt'
).to('cuda'),
max_new_tokens=256,
temperature=0.2,
top_p=1,
do_sample=True
)
print(tokenizer.decode(outputs[0]))