Downloads · 30 days
8
15% of all-time downloads
mixed-lora-1
UtsuSl0th/mixed-lora-1
mixed-lora-1 is a text generation model from UtsuSl0th. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
This repository provides a merged model fine-tuned from unsloth/Qwen2.5-7B-Instruct using LoRA + Unsloth.
All-time downloads
55
Public
Parameters
7.6B
19.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors17.2 GB · 87%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Feb 20, 2026
- Updated
- Feb 20, 2026
- SHA
- 226834f0
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen2.5-7B-Agent-Mixed-Trajectory-LoRA
This repository provides a merged model fine-tuned from unsloth/Qwen2.5-7B-Instruct using LoRA + Unsloth.
Dataset Construction
Training data was built by mixing and preprocessing two trajectory datasets:
- ALFWorld (
u-10bei/sft_alfworld_trajectory_dataset_v5): 2,327 samples after cleaning - DBBench (
u-10bei/dbbench_sft_dataset_react_v4): 1,200 samples after cleaning
Category-level upsampling was applied to reinforce weak task types:
| Category | Multiplier |
|---|---|
| ALFWorld multi-object | ×3 |
| ALFWorld cool | ×2 |
| ALFWorld examine | ×1.5 |
| DBBench aggregation-MAX | ×3 |
| DBBench INSERT | ×2 |
| DBBench counting | ×2 |
Final dataset size: 5,169 samples
Training Configuration
| Parameter | Value |
|---|---|
| Base model | unsloth/Qwen2.5-7B-Instruct |
| Method | LoRA + Unsloth (Colab Pro A100) |
| Max sequence length | 4096 |
| Epochs | 3 |
| Learning rate | 8e-6 |
| LoRA r / alpha | 64 / 128 |
| Effective batch size | 16 (bs=4 × grad_accum=4) |
Sources & Terms
Dataset License: MIT License. Users must comply with the MIT license and the base model's original terms of use.
- Task
- Text Generation
- Library
- peft
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Feb 20, 2026
- Updated
- Feb 20, 2026