Downloads · 30 days
3
11% of all-time downloads
doubutsu-2b-lora-378-docci
qresearch/doubutsu-2b-lora-378-docci
doubutsu-2b-lora-378-docci is a image-text-to-text model from qresearch. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
An adapter for qresearch/doubutsu-2b-pt-378 on DOCCI for 3 epochs.
All-time downloads
28
Public
Repo size
343 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors343 MB · 100%
At a glance
- Task
- Image-Text-to-Text
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Jul 22, 2024
- Updated
- Jul 22, 2024
- SHA
- a725c295
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
doubutsu-2b-lora-378-docci
An adapter for qresearch/doubutsu-2b-pt-378 on DOCCI for 3 epochs.
Usage
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
from PIL import Image
model_id = "qresearch/doubutsu-2b-pt-378"
model = AutoModelForCausalLM.from_pretrained(
model_id,
trust_remote_code=True,
torch_dtype=torch.float16,
).to("cuda")
tokenizer = AutoTokenizer.from_pretrained(
model_id,
use_fast=True,
)
model.load_adapter("qresearch/doubutsu-2b-lora-378-docci")
image = Image.open("IMAGE")
print(
model.answer_question(
image, "Describe the image", tokenizer, max_new_tokens=128, temperature=0.1
),
)
.x+=:.
z` ^% .uef^"
.u . . <k .u . :d88E
.u@u .d88B :@8c .u .@8Ned8" .u u .d88B :@8c . `888E
.zWF8888bx ="8888f8888r ud8888. .@^%8888" ud8888. us888u. ="8888f8888r .udR88N 888E .z8k
.888 9888 4888>'88" :888'8888. x88: `)8b. :888'8888. .@88 "8888" 4888>'88" <888'888k 888E~?888L
I888 9888 4888> ' d888 '88%" 8888N=*8888 d888 '88%" 9888 9888 4888> ' 9888 'Y" 888E 888E
I888 9888 4888> 8888.+" %8" R88 8888.+" 9888 9888 4888> 9888 888E 888E
I888 9888 .d888L .+ 8888L @8Wou 9% 8888L 9888 9888 .d888L .+ 9888 888E 888E
`888Nx?888 ^"8888*" '8888c. .+ .888888P` '8888c. .+ 9888 9888 ^"8888*" ?8888u../ 888E 888E
"88" '888 "Y" "88888% ` ^"F "88888% "888*""888" "Y" "8888P' m888N= 888>
88E "YP' "YP' ^Y" ^Y' "P' `Y" 888
98> J88"
'8 @%
` :"
- Task
- Image-Text-to-Text
- Library
- peft
- License
- apache-2.0
- Languages
- en
- Created
- Jul 22, 2024
- Updated
- Jul 22, 2024