Komdigi-3b-pad-merged

Komdigi-3b-pad-merged

Model Description

Komdigi-3b-pad-merged is a unified multi-task Vision-Language Model developed for the Perlindungan Anak di Ruang Digital (PAD) use case. Unlike a model that is limited to image analysis, this model is designed to handle multiple PAD-related tasks within a single architecture.

The model is trained as a unified VLM to perform:

1. Text classification with reasoning
2. Image classification with reasoning
3. Keyword generation

The main purpose of the model is to support content analysis, age-rating classification, reasoning generation, and keyword extraction in the context of digital child protection. It is intended for research, prototyping, and human-in-the-loop moderation systems.

Model Details

Supported Tasks

1. Text Classification with Reasoning

The model can analyze text-based content such as captions, posts, comments, or short-form digital content. It predicts the appropriate age-rating or content-safety category and provides a reasoning explanation for the prediction.

Example use cases:

• analyzing social media captions,
• classifying text-based digital content,
• generating explanation for the assigned rating,
• supporting human moderation review.

2. Image Classification with Reasoning

The model can analyze visual content and classify it into the appropriate PAD rating category. It can also generate reasoning based on visual evidence observed in the image.

Example use cases:

• analyzing social media images,
• detecting content that may not be suitable for certain age groups,
• explaining visual factors that influence the classification,
• supporting review of image-based content.

3. Keyword Generator

The model can generate relevant keywords from a given content context. This task is useful for indexing, search, moderation tagging, and content understanding.

Example use cases:

• generating moderation keywords,
• extracting relevant content tags,
• supporting content retrieval,
• improving downstream filtering or recommendation systems.

Intended Use

Direct Use

This model is intended for PAD-related content analysis, including:

1. classifying text content with reasoning,
2. classifying image content with reasoning,
3. generating relevant keywords from content context,
4. supporting content moderation workflows,
5. assisting age-rating recommendation,
6. supporting Indonesian child-safety research and prototyping.

Downstream Use

The model may be integrated into larger systems such as:

• content moderation dashboards,
• child-safety screening tools,
• age-rating recommendation systems,
• keyword tagging systems,
• content indexing pipelines,
• human-in-the-loop moderation platforms.

Out-of-Scope Use

This model should not be used as the sole authority for:

• final legal or regulatory decisions,
• fully automated content takedown,
• law enforcement decisions,
• identifying or profiling individuals,
• determining the real age or identity of a person,
• surveillance or invasive monitoring,
• medical, psychological, or legal assessment.

The model should assist human reviewers, not replace human judgment.

Rating Categories

The model is trained to classify content into the following PAD rating categories:

The exact interpretation of each category should follow the PAD annotation guideline used during dataset construction.

Recommended Output Format

For classification tasks, the model can be prompted to return structured JSON.

{
  "rating": "string",
  "reason": "string"
}

For keyword generation, the recommended output format is:

{
  "keywords": ["keyword_1", "keyword_2", "keyword_3"]
}

For a combined response, the following schema can be used:

{
  "task": "classification_or_keyword_generation",
  "rating": "string",
  "reason": "string",
  "keywords": ["keyword_1", "keyword_2", "keyword_3"]
}

Training Details

Training Dataset Composition

The model was trained using a unified multi-task supervised fine-tuning strategy. The training data combines task-specific datasets that were converted into a shared instruction-following format, allowing the same VLM architecture to learn text classification, image classification, reasoning generation, and keyword generation in a single training workflow.

The training notebook uses a combined multi-task dataset loaded from:

• nuresens/PAD-Combined-Dataset_v6

The dataset is separated into three task sources using the source field:

The three sources are merged into a single metadata dataset containing the following columns:

Feature Structure

The messages field follows a chat-style structure consisting of role and content. This structure allows the dataset to support multimodal supervised fine-tuning across different task instructions. Text classification and keyword generation samples are text-only instruction samples, while image classification samples include image placeholders and are lazily paired with their original images during collation.

Dataset Statistics

1. Image Classification and Reasoning Dataset

The image classification and reasoning dataset consists of 62,427 samples. The dataset is used to train the model to analyze visual content and predict the appropriate PAD rating category with an accompanying explanation.

The largest category in the image classification dataset is Semua Umur, representing 25.59% of the dataset. The remaining categories are distributed between approximately 10.92% and 15.09%, indicating a moderately imbalanced dataset.

2. Text Classification and Reasoning Dataset

The text classification and reasoning dataset consists of 13,406 rows. This dataset is used to train the model to classify text-based content into age-rating categories and generate explanations that justify the classification.

The text classification dataset is more imbalanced than the image classification dataset. The largest category is Konten Terlarang, representing 33.54% of the dataset, followed by Semua Umur at 24.26%. The smaller categories, especially 18+ and 7+, should be monitored carefully during evaluation using macro-averaged metrics.

3. Keyword Generator Dataset

The keyword generator dataset consists of 15,030 records. This dataset is used to train the model to generate a variable number of relevant keywords from a given content context.

The keyword generator dataset is concentrated around outputs containing 3 to 4 keywords, which together account for 55.83% of all records. The average number of keywords per record is approximately 3.81, with a median and mode of 3 keywords. This indicates that the keyword generation task is primarily optimized for concise keyword outputs rather than long keyword lists.

Dataset Split

The dataset is split using a source-aware strategy. Each source is split independently using an 80:10:10 ratio, then recombined into train, validation, and test splits. This ensures that all tasks remain represented proportionally in each split.

Overall Split

Split by Task Source

Training Procedure

This model was trained using a unified multi-task fine-tuning strategy. Instead of training separate models for text classification, image classification, and keyword generation, all tasks were learned by a single Vision-Language Model.

The model was fine-tuned end-to-end using task-specific prompts and responses in a shared multimodal instruction format. This allows the model to preserve a unified latent representation across tasks and reduces the risk of performance degradation caused by separate adapter merging.

Training Configuration

The model was fine-tuned using Unsloth FastVisionModel and TRL SFTTrainer. Training was performed as multi-task supervised fine-tuning over the merged dataset containing text classification, image classification, and keyword generation tasks.

Base Model and Sequence Configuration

The notebook applies the chat template from mistralai/Ministral-3-3B-Instruct-2512 to the model processor and tokenizer so that the training format follows the instruction-style format expected by the model.

LoRA Configuration

The model was fine-tuned using LoRA. Both the vision and language components were enabled for fine-tuning.

The training run reported 33,751,040 trainable parameters out of 3,882,841,088 total parameters, meaning approximately 0.87% of the model parameters were trained.

Data Collation

The notebook uses UnslothVisionDataCollator with a custom lazy image collation strategy. Images are loaded only when a sample has an image marker, which reduces unnecessary image decoding for text-only samples.

The training loss is computed only on the assistant response, which is useful for instruction tuning because the model is optimized to generate the expected output rather than reproduce the full prompt.

SFT Training Arguments

Training Run Summary

Evaluation

The model was evaluated across three main tasks: text classification with reasoning, image classification with reasoning, and keyword generation. The evaluation results show that the unified model is able to maintain strong performance across tasks without significant signs of negative interference.

Text Classification with Reasoning

Image Classification with Reasoning

Keyword Generator

Limitations

The model has several limitations:

1. The model may produce incorrect predictions for ambiguous or context-dependent content.
2. The model may be sensitive to prompt wording and output-format instructions.
3. For text classification, the model may misinterpret slang, sarcasm, coded language, or culturally specific expressions.
4. For image classification, the model may under-detect subtle harmful content when visual evidence is unclear.
5. For keyword generation, the model may generate overly broad or incomplete keywords if the input context is vague.
6. The model may generate explanations that sound plausible but are not fully grounded in the input.
7. The model may not fully capture legal, cultural, or platform-specific policy nuances.
8. The model should not be used without human review for high-impact moderation decisions.

Bias, Risks, and Safety Considerations

Content moderation and age-rating models can reflect biases in their datasets, annotation guidelines, and policy definitions. Performance may vary across language, cultural context, visual style, demographic representation, and content source.

Potential risks include:

• false positives that incorrectly flag safe content,
• false negatives that miss harmful or restricted content,
• inconsistent treatment of culturally specific content,
• unsupported or hallucinated explanations,
• over-reliance on automated moderation,
• irrelevant or misleading generated keywords.

Recommended mitigations:

1. Use human-in-the-loop review for sensitive cases.
2. Evaluate the model separately for text, image, and keyword generation tasks.
3. Monitor per-class performance, especially for minority rating categories.
4. Use strict JSON schemas during inference.
5. Keep audit logs for model predictions in production systems.
6. Re-evaluate the model after dataset, taxonomy, or policy changes.
7. Combine the model with rule-based policy checks and escalation mechanisms.

Recommended Deployment Setting

For deployment, the model should be used as part of a larger PAD analysis pipeline:

1. Content is submitted as text, image, or image-text input.
2. The system routes the input to the appropriate task prompt.
3. The model predicts the rating, generates reasoning, or produces keywords.
4. A validation layer checks JSON format and allowed labels.
5. High-risk or uncertain cases are escalated to human reviewers.
6. Final decisions and model outputs are logged for audit and future evaluation.

Ethical Considerations

This model is developed to support safer digital content access and child protection. It should be used responsibly, proportionally, and transparently. The model should not be used for surveillance, profiling, punitive action, or automated enforcement without appropriate human oversight, governance, and accountability.

Citation

If you use this model, please cite it as:

@misc{komdigi_3b_pad_merged,
  title = {Komdigi-3b-pad-merged: A Unified Vision-Language Model for Text Classification, Image Classification, and Keyword Generation in Perlindungan Anak di Ruang Digital},
  author = {AITF Komdigi},
  year = {2026},
  publisher = {Hugging Face},
  howpublished = {\url{https://huggingface.co/aitf-komdigi/Komdigi-3b-pad-merged}}
}

Contact

For questions, issues, or collaboration, please use the Hugging Face repository discussion page.