Downloads · 30 days
0
GiteshUjgaonkar/chatbot-v02
chatbot-v02 is a machine learning model from GiteshUjgaonkar. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
This is a fine-tuned conversational model using PEFT adapters and a base LLM.
Downloads · 30 days
0
Access
Public
Updated Apr 16, 2025
Repo size
18.5 MB
Likes
0
Public
Click a slice to open those files.
.safetensors18 MB · 81%
From the Hugging Face model README
This is a fine-tuned conversational model using PEFT adapters and a base LLM.
from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline
from peft import PeftModel
base_model = AutoModelForCausalLM.from_pretrained("tiiuae/falcon-rw-1b", trust_remote_code=True)
model = PeftModel.from_pretrained(base_model, "GiteshUjgaonkar/chatbot-v02")
tokenizer = AutoTokenizer.from_pretrained("tiiuae/falcon-rw-1b")
pipe = pipeline("text-generation", model=model, tokenizer=tokenizer)
prompt = "<|system|>\nYou are a helpful AI assistant.\n<|user|>\nTell me a joke.\n<|assistant|>\n"
response = pipe(prompt, max_length=200, do_sample=True)[0]["generated_text"]
print(response)