Downloads · 30 days
12
18% of all-time downloads
yujuyeon/internvl3_5-1b-korean-lora-r32
internvl3_5-1b-korean-lora-r32 is a image-text-to-text model from yujuyeon. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as other.
OpenGVLab/InternVL35-1B 를 한국어 멀티모달 데이터로 파인튜닝한 InternVL3.5 specialist.
Downloads · 30 days
12
18% of all-time downloads
All-time downloads
65
Public
Parameters
1.1B
6.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors8.7 GB · 100%
From the Hugging Face model README
OpenGVLab/InternVL3_5-1B 를 한국어 멀티모달 데이터로 파인튜닝한 InternVL3.5 specialist.
| 항목 | 값 |
|---|---|
| Base model | OpenGVLab/InternVL3_5-1B |
| Method | LoRA r32, 3 epoch |
| Domain | 한국어 종합 347k |
365145 / max 6514543.9999999382064654e-05| step | loss |
|---|---|
| 10 | 1.5987 |
| 6520 | 0.8878 |
| 13030 | 0.8402 |
| 19540 | 0.7112 |
| 26050 | 0.6731 |
| 32560 | 0.6954 |
| 39070 | 0.7273 |
| 45580 | 0.6619 |
| 52090 | 0.6392 |
| 58600 | 0.6870 |
| 65110 | 0.7508 |
| 65140 | 0.6771 |
구성: 18개 서브셋 (한국어 specialist SFT)
| subset | repeat |
|---|---|
aihub_visual_ShortQA_30k | 1 |
hf_korLlava_Caption_20k | 1 |
llava_ko_recap_30k | 1 |
out_kor_llava_20k | 1 |
chartRqa1_30k | 1 |
chartRqa2_20k | 1 |
tableVqa_Reason_20k | 1 |
tableVqa_Caption_20k | 1 |
aihub_subjectTxt_OCR_20k | 1 |
aihub_visual_OCR_15k | 1 |
kisti_arxiv_OCR_15k | 1 |
kisti_hanbat_Reason_30k | 1 |
kisti_documen_Reason_10k | 1 |
aihub_mathMultiple_kor_M0 | 1 |
aihub_mathSubjective_kor_M0 | 1 |
kisti_hanbat_Vqa_25k | 1 |
hf_latexUpdate_15k | 1 |
aihub_subjectImg_Parse_10k | 1 |
from transformers import AutoModel, AutoTokenizer
import torch
m = AutoModel.from_pretrained("yujuyeon/internvl3_5-1b-korean-lora-r32", torch_dtype=torch.bfloat16,
trust_remote_code=True).eval().cuda()
tok = AutoTokenizer.from_pretrained("yujuyeon/internvl3_5-1b-korean-lora-r32", trust_remote_code=True, use_fast=False)