Downloads · 30 days
12
18% of all-time downloads
codegen-350M-mono-QLoRa-flytech
yamete4/codegen-350M-mono-QLoRa-flytech
codegen-350M-mono-QLoRa-flytech is a text generation model from yamete4. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as mit.
All-time downloads
68
Public
Repo size
63 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pt21 MB · 60%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- mit
- Access
- Public
- Created
- Mar 14, 2024
- Updated
- Mar 18, 2024
- SHA
- 6e7cb04b
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
How to Get Started with the Model
import torch
from transformers import AutoModelForCausalLM, BitsAndBytesConfig
from peft import PeftModel, PeftConfig
config = PeftConfig.from_pretrained("yamete4/codegen-350M-mono-QLoRa-flytech")
model = AutoModelForCausalLM.from_pretrained("shpotes/codegen-350M-mono",
quantization_config=BitsAndBytesConfig(config),)
peft_model = PeftModel.from_pretrained(model, "yamete4/codegen-350M-mono-QLoRa-flytech")
text = "Help me manage my subscriptions!?"
inputs = tokenizer(text, return_tensors="pt").to(0)
outputs = perf_model.generate(inputs.input_ids, max_new_tokens=250, do_sample=False)
print(tokenizer.decode(outputs[0], skip_special_tokens=False))
Framework versions
- PEFT 0.9.0
- Task
- Text Generation
- Library
- peft
- License
- mit
- Created
- Mar 14, 2024
- Updated
- Mar 18, 2024