Downloads · 30 days
14
0% of all-time downloads
LLAMA-2-13b-ko-Y24_v2.0
AIdenU/LLAMA-2-13b-ko-Y24_v2.0
LLAMA-2-13b-ko-Y24_v2.0 is a text generation model from AIdenU. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
18K
Public
Repo size
26 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin26 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jan 24, 2024
- Updated
- Mar 7, 2024
- SHA
- fce6787e
Model card
From the Hugging Face model README
BaseModel
Model Generation
from transforemrs import AutoTokenizer, AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("AIdenU/LLAMA-2-13b-ko-Y24_v2.0", device_map="auto")
tokenizer = AutoTokenizer.from_pretrained("AIdenU/LLAMA-2-13b-ko-Y24_v2.0", use_fast=True)
systemPrompt = "당신은 유능한 AI입니다."
prompt = "지렁이도 밟으면 꿈틀하나요?"
outputs = model.generate(
**tokenizer(
f"[INST] <<SYS>>\n{systemPrompt}\n<</SYS>>\n\n{prompt} [/INST] ",
return_tensors='pt'
).to('cuda'),
max_new_tokens=256,
temperature=0.2,
top_p=1,
do_sample=True
)
print(tokenizer.decode(outputs[0]))
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- ko
- Created
- Jan 24, 2024
- Updated
- Mar 7, 2024