Downloads · 30 days
13
6% of all-time downloads
mananshah296/medbot
medbot is a text generation model from mananshah296. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This model was fine-tuned on medical presciption dataset containing fields like condition, drug, type, information etc.
Downloads · 30 days
13
6% of all-time downloads
All-time downloads
211
Public
Repo size
13.2 MB
Likes
3
Public
Click a slice to open those files.
.safetensors12.7 MB · 75%
From the Hugging Face model README
This model was fine-tuned on medical presciption dataset containing fields like condition, drug, type, information etc.
from transformers import AutoModelForCausalLM, AutoTokenizer
model_path = "mananshah296/medbot"
tokenizer = AutoTokenizer.from_pretrained(model_path)
model = AutoModelForCausalLM.from_pretrained(
model_path,
device_map="auto",
torch_dtype='auto'
).eval()
# Prompt content: "hi"
messages = [
{"role": "user", "content": "hi"}
]
input_ids = tokenizer.apply_chat_template(conversation=messages, tokenize=True, add_generation_prompt=True, return_tensors='pt')
output_ids = model.generate(input_ids.to('cuda'))
response = tokenizer.decode(output_ids[0][input_ids.shape[1]:], skip_special_tokens=True)
# Model response: "Hello! How can I assist you today?"
print(response)