Downloads · 30 days
3
4% of all-time downloads
qwensft-v5
mirukumiruku/qwensft-v5
qwensft-v5 is a machine learning model from mirukumiruku. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Qwen/Qwen2.5-7B-Instruct をベースに、AgentBench DB Bench タスク向けに QLoRA SFT を行ったモデルです。
All-time downloads
71
Public
Parameters
7.6B
15.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors15.2 GB · 100%
At a glance
- Model type
- qwen2
- Access
- Public
- Created
- Feb 25, 2026
- Updated
- Feb 25, 2026
- SHA
- e3fa6cb9
Model card
From the Hugging Face model README
qwensft-v5
Qwen/Qwen2.5-7B-Instruct をベースに、AgentBench DB Bench タスク向けに QLoRA SFT を行ったモデルです。
Base Model
- Qwen/Qwen2.5-7B-Instruct
Training
- 手法: QLoRA SFT (4-bit quantization + LoRA, merged)
- LoRA: r=16, alpha=32, dropout=0.05
- 学習率: 3e-5
- エポック数: 1
- データセット: WikiSQL スキーマベースの合成データ (1,500 samples)
- SELECT: 600 samples
- INSERT: 600 samples
- UPDATE: 300 samples
- 精度: BF16
- 学習環境: Google Colab (T4 GPU)
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("mirukumiruku/qwensft-v5", torch_dtype="bfloat16", device_map="auto")
tokenizer = AutoTokenizer.from_pretrained("mirukumiruku/qwensft-v5")
License
This model inherits the license of the base model Qwen/Qwen2.5-7B-Instruct.
- Type
- qwen2
- Created
- Feb 25, 2026
- Updated
- Feb 25, 2026