Downloads · 30 days
8
13% of all-time downloads
canbingol/qwen2.5-3B-Instruct-tool-call-en-norobots
qwen2.5-3B-Instruct-tool-call-en-norobots is a machine learning model from canbingol. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
LoRA fine-tune of Qwen/Qwen2.5-3B-Instruct for function/tool calling.
Downloads · 30 days
8
13% of all-time downloads
All-time downloads
60
Public
Repo size
251 MB
Likes
0
Public
Click a slice to open those files.
.safetensors240 MB · 95%
From the Hugging Face model README
LoRA fine-tune of Qwen/Qwen2.5-3B-Instruct for function/tool calling.
apply_chat_templater=32, lora_alpha=64, lora_dropout=0.05, target_modules=all-linear, bias=none, task_type=CAUSAL_LM
lr=2e-4, epochs=1, per_device_batch=8, grad_accum=16 (effective 128), warmup_ratio=0.03, max_grad_norm=0.3, bf16=True, attn_implementation=sdpa, loss_type=nll
train_loss=0.360, val_loss=0.174, mean_token_accuracy=0.956, runtime≈3h47m (A100)