Gukbap-Gemma3-27B-VL

HumanF-MarkrAI/Gukbap-Gemma3-27B-VL🍚

Model Details🍚

Model Description

• Developed by: HumanF-MarkrAI
• Model type: Korean-VL-Gemma3-27B
• Language(s): Korean + English
• Context Length: 2048
• License: cc-by-nc-4.0
• Finetuned from model: google/gemma-3-27b-it.

Model Sources

When training, we used H100 80GB GPUx6.

Implications🍚

If you want to know our model's details, please see 🔥Gukbap-LMM Blog🔥.

Training Method (SFT)🧐

The following papers contain the foundational methodologies for the dataset and training methods we are currently proceeding.

• LIMA.
• Gemma3.

SFT Text-Datasets (Private)

When we made the Open-Source based dataset, we use microsoft/WizardLM-2-8x22B through DeepInfra.
Our datasets are made by Evolving system, which is propsed by WizardLM. In training, we used 1849 training dataset, and 200 validation dataset.

• Wizard-Korea-Datasets: MarkrAI/Markr_WizardLM_train_ver4.

Learning rate: 1e-5; Epoch: 3

Benchmakrs🤗

Korean MM Benchmark Score (Zero-shot)

We internally evaluated 🔥our code🔥.
We utilized gpt-4o-2024-08-06 in K-LLAVA-W evaluation.

MM Benchmarks

• Global MM Bench dataset: OpenCampass MM leaderboard
• Korean MM Bench dataset: NCSOFT.

Gukbap-VL Series models🍚🍚

• HumanF-MarkrAI/Gukbap-Gemma2-9B-VL
• HumanF-MarkrAI/Gukbap-Gemma3-4B-VL
• HumanF-MarkrAI/Gukbap-Gemma3-12B-VL
• HumanF-MarkrAI/Gukbap-Gemma3-27B-VL

BibTeX

@article{HumanF-MarkrAI,
  title={Gukbap-Gemma3-27B-VL},
  author={MarkrAI},
  year={2025},
  url={https://huggingface.co/HumanF-MarkrAI}
}