Qwen3-4B-toolcall-GGUF

wesjos/Qwen3-4B-toolcall-GGUF

Qwen3-4B-toolcall-GGUF is a machine learning model from wesjos. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.

Downloads · 30 days

356

12% of all-time downloads

All-time downloads

2.9K

Public

Repo size

126 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf17.7 GB · 100%

At a glance

Library: transformers
License: apache-2.0
Model type: qwen3
Access: Public
Created: Jul 28, 2025
Updated: Oct 11, 2026
SHA: 42954ae8

Base models

Qwen/Qwen3-4B

Model card

From the Hugging Face model README

Eval

Before finetuning (unsloth/Qwen3-4B-unsloth-bnb-4bit)

Model	Dataset	Metric	Subset	Num	Score	Cat.0
qwen	gpqa	AveragePass@1	gpqa_extended	50	0.24	default
qwen	gpqa	AveragePass@1	gpqa_main	50	0.26	default
qwen	gpqa	AveragePass@1	gpqa_diamond	50	0.22	default
qwen	gpqa	AveragePass@1	OVERALL	150	0.24	-
qwen	gsm8k	AverageAccuracy	main	50	0.50	default
qwen	tool_bench	Act.EM	in_domain	42	0.1667	default
qwen	tool_bench	Act.EM	out_of_domain	48	0.1667	default
qwen	tool_bench	Act.EM	OVERALL	90	0.1667	-

After finetuning (This model)

Model	Dataset	Metric	Subset	Num	Score	Cat.0
model	gpqa	AveragePass@1	gpqa_extended	50	0.26	default
model	gpqa	AveragePass@1	gpqa_main	50	0.36	default
model	gpqa	AveragePass@1	gpqa_diamond	50	0.38	default
model	gpqa	AveragePass@1	OVERALL	150	0.3333	-
model	gsm8k	AverageAccuracy	main	50	0.68	default
model	tool_bench	Act.EM	in_domain	41	0.3171	default
model	tool_bench	Act.EM	out_of_domain	47	0.3191	default
model	tool_bench	Act.EM	OVERALL	88	0.3182	-

Qwen/Qwen3-4B model

Model	Dataset	Metric	Subset	Num	Score	Cat.0
model	gpqa	AveragePass@1	gpqa_extended	50	0.32	default
model	gpqa	AveragePass@1	gpqa_main	50	0.22	default
model	gpqa	AveragePass@1	gpqa_diamond	50	0.18	default
model	gpqa	AveragePass@1	OVERALL	150	0.24	-
model	gsm8k	AverageAccuracy	main	50	0.48	default
model	tool_bench	Act.EM	in_domain	43	0.1628	default
model	tool_bench	Act.EM	out_of_domain	47	0.1702	default
model	tool_bench	Act.EM	OVERALL	90	0.1667	-

Use this model

with llama-cli

<code>llama-cli -m Qwen3-4B-toolcall.Q4_K_M.gguf</code>

with ollama

edit a makefile named(Qwen3-4B-toolcall.Q4_K_M.txt) like:
<pre>

FROM ./Qwen3-4B-toolcall.Q4_K_M TEMPLATE """<|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assistant """ </pre>

then create a model using ollama
<code>ollama create Qwen3-4B-toolcall.Q4_K_M -f Qwen3-4B-toolcall.Q4_K_M.txt</code>
then run it
<code>ollama run Qwen3-4B-toolcall.Q4_K_M</code>

Library: transformers
Type: qwen3
License: apache-2.0
Languages: en
Created: Jul 28, 2025
Updated: Oct 11, 2026