Downloads · 30 days
10
4% of all-time downloads
openllama-zh-7B
ocisd4/openllama-zh-7B
openllama-zh-7B is a text generation model from ocisd4. Use it when you need the model to write or continue text. It is set up for transformers.
The is a 7B pretrain model, train from openllama pretrain weight, context size=2048
All-time downloads
256
Public
Repo size
55.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin27.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Jul 6, 2023
- Updated
- Jul 6, 2023
- SHA
- 6bc90efc
Try a prompt
Model card
From the Hugging Face model README
import torch
from transformers import LlamaTokenizer, LlamaForCausalLM
import transformers
tokenizer = LlamaTokenizer.from_pretrained(
'ocisd4/openllama-zh',
add_bos_token=False,
add_eos_token=False,
use_auth_token=True,
use_fast=False)
model = LlamaForCausalLM.from_pretrained('ocisd4/openllama-zh', device_map='auto',use_auth_token=True)
prompt = '關於華碩的傳說'
input_ids = tokenizer(prompt, return_tensors="pt").input_ids
generation_output = model.generate(
input_ids=input_ids, max_new_tokens=256,
do_sample=True, top_k=40, top_p=0.95, temperature=0.7, repetition_penalty=1.08,
)
print(tokenizer.decode(generation_output[0]))
The is a 7B pretrain model, train from openllama pretrain weight, context size=2048
keep updating new model
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Jul 6, 2023
- Updated
- Jul 6, 2023