Downloads · 30 days
0
finetunedQwen3-4B-Instruct-WSD-Advanced-reasoning
deshanksuman/finetunedQwen3-4B-Instruct-WSD-Advanced-reasoning
finetunedQwen3-4B-Instruct-WSD-Advanced-reasoning is a text classification model from deshanksuman. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: deshanksuman - License: apache-2.0 - Finetuned from model : Qwen/Qwen3-4B
Access
Public
Updated Aug 6, 2025
Repo size
144 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors132 MB · 89%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Aug 5, 2025
- Updated
- Aug 6, 2025
- SHA
- 986f3b5a
Try a prompt
Base models
Model card
From the Hugging Face model README
Uploaded model
- Developed by: deshanksuman
- License: apache-2.0
- Finetuned from model : Qwen/Qwen3-4B
Dataset
Fews Training data arranged in the format of Instruction, Input and output with advanced Reasonining for sense identification. The data generation has been semi automated using the Arcee models. The data has been validated by the human for it's structure and the correctnes.
The data source can be accessed here: deshanksuman/Reasoning_WSD_dataset
Hyperparameter for Training
- per_device_train_batch_size=4,
- gradient_accumulation_steps=8,
- warmup_steps=50,
- num_train_epochs=2,
- learning_rate=2e-4,
- fp16=not torch.cuda.is_bf16_supported(),
- bf16=torch.cuda.is_bf16_supported(),
- logging_steps=10,
- optim="adamw_torch",
- weight_decay=0.01,
- lr_scheduler_type="linear",
- seed=3407
This is developed by Deshan Sumanathilaka https://sumanathilaka.github.io
Acknowledgement
We acknowledge the support of the Supercomputing Wales project, which is part-funded by the European Regional Development Fund (ERDF) via Welsh Government.
- Task
- Text Classification
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- Aug 5, 2025
- Updated
- Aug 6, 2025