Downloads · 30 days
119
7% of all-time downloads
RichardErkhov/AIdenU_-_LLAMA-2-13b-koen-Y24_v1.0-gguf
AIdenU_-_LLAMA-2-13b-koen-Y24_v1.0-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
119
7% of all-time downloads
All-time downloads
1.8K
Public
Repo size
147 GB
Likes
0
Public
Click a slice to open those files.
.gguf171 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
LLAMA-2-13b-koen-Y24_v1.0 - GGUF
license: apache-2.0 language:
from transforemrs import AutoTokenizer, AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("AIdenU/LLAMA-2-13b-koen-Y24_v1.0", device_map="auto")
tokenizer = AutoTokenizer.from_pretrained("AIdenU/LLAMA-2-13b-koen-Y24_v1.0", use_fast=True)
systemPrompt = "당신은 유능한 AI입니다."
prompt = "지렁이도 밟으면 꿈틀하나요?"
outputs = model.generate(
**tokenizer(
f"[INST] <<SYS>>\n{systemPrompt}\n<</SYS>>\n\n{prompt} [/INST] ",
return_tensors='pt'
).to('cuda'),
max_new_tokens=256,
temperature=0.2,
top_p=1,
do_sample=True
)
print(tokenizer.decode(outputs[0]))