Downloads · 30 days
20
0% of all-time downloads
SOLAR-10.7b-ko-Y24_v1.0
AIdenU/SOLAR-10.7b-ko-Y24_v1.0
SOLAR-10.7b-ko-Y24_v1.0 is a text generation model from AIdenU. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
35K
Public
Parameters
10.7B
21.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors21.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Mar 18, 2024
- Updated
- Mar 18, 2024
- SHA
- 12af074c
Model card
From the Hugging Face model README
BaseModel
Model Generation
from transforemrs import AutoTokenizer, AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("AIdenU/SOLAR-10.7b-ko-Y24_v1.0", device_map="auto", torch_dtype=torch.float16)
tokenizer = AutoTokenizer.from_pretrained("AIdenU/SOLAR-10.7b-ko-Y24_v1.0", use_fast=True)
prompt = [
{'role': 'system', 'content': '당신은 지시를 매우 잘 따르는 인공지능 비서입니다.'},
{'role': 'user', 'content': '지렁이도 밟으면 꿈틀하나요?'}
]
outputs = model.generate(
**tokenizer(
tokenizer.apply_chat_template(prompt, tokenize=False, add_generation_prompt=True),
return_tensors='pt'
).to('cuda'),
max_new_tokens=256,
temperature=0.2,
top_p=1,
do_sample=True
)
print(tokenizer.decode(outputs[0]))
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- ko
- Featherless Ai
- live
- Created
- Mar 18, 2024
- Updated
- Mar 18, 2024