Downloads · 30 days
0
finetuned-gemma-3-4b-it-WSD_Think
deshanksuman/finetuned-gemma-3-4b-it-WSD_Think
finetuned-gemma-3-4b-it-WSD_Think is a machine learning model from deshanksuman. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: deshanksuman - License: apache-2.0 - Finetuned from model : google/gemma-3-4b-it
Access
Public
Updated Jul 23, 2025
Repo size
169 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors131 MB · 77%
At a glance
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Jul 23, 2025
- Updated
- Jul 23, 2025
- SHA
- 4651e285
Base models
Model card
From the Hugging Face model README
Uploaded model
- Developed by: deshanksuman
- License: apache-2.0
- Finetuned from model : google/gemma-3-4b-it
Dataset
Fews Training data arranged in the format of Instruction, Input and output deshanksuman/Instruct_Finetune_with_Reasoning_WSD
Hyperparameter for Training
- per_device_train_batch_size=4,
- gradient_accumulation_steps=8,
- warmup_steps=50,
- num_train_epochs=1,
- learning_rate=2e-4,
- fp16=not torch.cuda.is_bf16_supported(),
- bf16=torch.cuda.is_bf16_supported(),
- logging_steps=10,
- optim="adamw_torch",
- weight_decay=0.01,
- lr_scheduler_type="linear",
- seed=3407
This is developed by Deshan Sumanathilaka https://sumanathilaka.github.io
Acknowledgement
We acknowledge the support of the Supercomputing Wales project, which is part-funded by the European Regional Development Fund (ERDF) via Welsh Government.
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- Jul 23, 2025
- Updated
- Jul 23, 2025