Downloads · 30 days
0
Hassam-Nazir/llama2_7b_SQL
llama2_7b_SQL is a question answering model from Hassam-Nazir. Use it when the input is a question plus a passage.
Epoch=50 dataset rows= 1000 <br Dataset:<br "Q,A" <br "Context, Query"<br <br from transformers import AutoTokenizer, pipeline <br from peft import AutoPeftModelForCausalLM <br
Downloads · 30 days
0
Access
Public
Updated Dec 21, 2023
Repo size
125 MB
Likes
0
Public
Click a slice to open those files.
.zip125 MB · 100%
From the Hugging Face model README
Epoch=50 dataset rows= 1000 <br> Dataset:<br> "Q,A" <br> "Context, Query"<br> <br> from transformers import AutoTokenizer, pipeline <br> from peft import AutoPeftModelForCausalLM <br>
new_model = path <br> tokenizer = AutoTokenizer.from_pretrained(new_model)<br> model = AutoPeftModelForCausalLM.from_pretrained(new_model, load_in_4bit=True)<br> prompt = "Provide an example sql query."<br> answer = LLM(prompt, model, tokenizer)<br> answer