Downloads · 30 days
8
13% of all-time downloads
aitf-komdigi/KomdigiITS-8B-DFK-TextClassification-Final
KomdigiITS-8B-DFK-TextClassification-Final is a image-text-to-text model from aitf-komdigi. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Text Classification DFK (Disinformasi, Fitnah, Ujaran Kebencian)
Downloads · 30 days
8
13% of all-time downloads
All-time downloads
61
Public
Parameters
8.9B
17.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors17.8 GB · 100%
From the Hugging Face model README
DISINFORMASIFITNAHUJARAN KEBENCIANFAKTABUKAN DFK| Parameter | Value |
|---|---|
| Max Sequence Length | 2048 tokens |
| Batch Size | 2 |
| Gradient Accumulation Steps | 16 |
| Effective Batch Size | 32 |
| Learning Rate (LR) | 2e-4 |
| LR Scheduler | Linear |
| Optimizer | AdamW 8-bit |
| Number of Epochs | 1 |
| Warmup Steps | 20 |
| Weight Decay | 0.01 |
| Max Gradient Norm | 1.0 |
| Evaluation Steps | Every 200 steps |
| Parameter | Value |
|---|---|
| r (Rank) | 16 |
| lora_alpha | 32 |
| lora_dropout | 0 |
| bias | none |
| use_rslora | False |
| Gradient Checkpointing | unsloth |
| Target Modules | q_proj, k_proj, v_proj, o_proj, gate_proj, down_proj, up_proj |
This mistral3 model was trained 2x faster with Unsloth