Downloads · 30 days
0
advanced-test04
peanuts33/advanced-test04
advanced-test04 is a text generation model from peanuts33. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
LoRA adapter fine-tuned from Qwen/Qwen3-4B-Instruct-2507 using Unsloth.
Access
Public
Updated Feb 23, 2026
Parameters
4B
8.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Feb 23, 2026
- Updated
- Feb 23, 2026
- SHA
- 37124c56
Try a prompt
Base models
Model card
From the Hugging Face model README
qwen3-4b-agent-trajectory-lora-test04
LoRA adapter fine-tuned from Qwen/Qwen3-4B-Instruct-2507 using Unsloth.
Key Improvement (vs test03)
ALFWorld training data (v3/v5) was in function-calling format, but the evaluation environment expects ReAct text format (THOUGHT/ACTION). This mismatch caused test03 to score significantly lower than test02.
test04 converts ALFWorld data to ReAct format before training:
assistant+tool_calls→THOUGHT: <think>\nACTION: <action>texttoolrole →userrole (matching eval environment observation format)
Training Configuration
- Base model: Qwen/Qwen3-4B-Instruct-2507
- Data: ALFWorld (v3+v5, ReAct-converted) + DBBench v4 × 3
- Max sequence length: 2048
- Epochs: 2
- Learning rate: 2e-06
- LoRA: r=64, alpha=128
Sources
- u-10bei/sft_alfworld_trajectory_dataset_v3
- u-10bei/sft_alfworld_trajectory_dataset_v5
- u-10bei/dbbench_sft_dataset_react_v4
- Task
- Text Generation
- Library
- peft
- Type
- qwen3
- License
- apache-2.0
- Languages
- en
- Created
- Feb 23, 2026
- Updated
- Feb 23, 2026