Downloads · 30 days
35
10% of all-time downloads
crewai-qwen3-4b-gguf
rchow93/crewai-qwen3-4b-gguf
crewai-qwen3-4b-gguf is a machine learning model from rchow93. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Fine-tuned Qwen3-4B models for CrewAI code generation.
All-time downloads
346
Public
Repo size
16.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf16.4 GB · 100%
At a glance
- Access
- Public
- Created
- Dec 28, 2025
- Updated
- Dec 31, 2025
- SHA
- c6454082
Model card
From the Hugging Face model README
CrewAI Qwen3-4B GGUF Models
Fine-tuned Qwen3-4B models for CrewAI code generation.
Available Models
V2 Thinking Models (Recommended)
These models use Qwen3 native chat template with <think> reasoning tags.
| File | Size | Description |
|---|---|---|
| crewai-qwen3-4b-thinking-v2-q4_k_m.gguf | 2.4 GB | Best balance of size/quality |
| crewai-qwen3-4b-thinking-v2-q8_0.gguf | 4.0 GB | Higher quality |
V1 Models (Legacy)
Original models using Alpaca-style template.
| File | Size |
|---|---|
| qwen3-4b.Q4_K_M.gguf | 2.4 GB |
| qwen3-4b.Q5_K_M.gguf | 2.7 GB |
| qwen3-4b.Q8_0.gguf | 4.0 GB |
V2 Improvements
- Native Qwen3 chat template (better tokenization)
- Thinking mode with
<think>tags for reasoning - LoRA r=32, alpha=32 (higher capacity)
- Trained on 2,500 CrewAI examples
Usage with Ollama
# Download the model
wget https://huggingface.co/rchow93/crewai-qwen3-4b-gguf/resolve/main/crewai-qwen3-4b-thinking-v2-q4_k_m.gguf
# Create Modelfile
cat > Modelfile << EOF
FROM ./crewai-qwen3-4b-thinking-v2-q4_k_m.gguf
TEMPLATE """{{- if .System }}
<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
"""
SYSTEM """You are a CrewAI code generation expert."""
PARAMETER temperature 0.7
PARAMETER num_ctx 8192
PARAMETER stop "<|im_end|>"
EOF
# Create and run
ollama create crewai-qwen3-4b -f Modelfile
ollama run crewai-qwen3-4b
Training Details
- Base model: unsloth/Qwen3-4B
- Dataset: 2,500 CrewAI code examples
- Method: QLoRA with Unsloth
- Epochs: 3
- Created
- Dec 28, 2025
- Updated
- Dec 31, 2025