Downloads · 30 days
4
7% of all-time downloads
openthaigpt-7b-customer-support-th
Porameht/openthaigpt-7b-customer-support-th
openthaigpt-7b-customer-support-th is a text generation model from Porameht. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
61
Public
Parameters
6.9B
27.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors27.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- May 4, 2024
- Updated
- May 5, 2024
- SHA
- 5ecb6b96
Model card
From the Hugging Face model README
How to use
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
# Ensure CUDA is available
device = 'cuda' if torch.cuda.is_available() else 'cpu'
print(f"Using device: {device}")
# Init Model
model_path="Porameht/openthaigpt-7b-customer-support-th"
tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(model_path, trust_remote_code=True, torch_dtype=torch.float16)
model.to(device)
# Prompt
prompt = "ต้องการยกเลิกออเดอร์"
llama_prompt = f"<s>[INST] <<SYS>>\nYou are a question answering assistant. Answer the question as truthful and helpful as possible คุณคือผู้ช่วยตอบคำถาม จงตอบคำถามอย่างถูกต้องและมีประโยชน์ที่สุด<</SYS>>\n\n{prompt} [/INST]"
inputs = tokenizer.encode(llama_prompt, return_tensors="pt")
inputs = inputs.to(device)
# Generate
outputs = model.generate(inputs, max_length=512, num_return_sequences=1)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- th
- Created
- May 4, 2024
- Updated
- May 5, 2024