qwen3-4b-sql-grpo_202602221210_fin

qwen3-4b-sql-grpo_202602221210_fin

This repository provides a merged model (base + LoRA) fine-tuned from deyucao/qwen3-4b-agent-trajectory-lora_2026021805 using GRPO (Group Relative Policy Optimization) + Unsloth.

This is the fully merged model — no separate adapter loading is required.

Training Objective

This model is trained via GRPO to improve text-to-SQL generation accuracy. Reward signals are derived from:

1. SQL Execution Reward — whether the generated SQL executes successfully
2. SQL Correctness Reward — whether the execution result matches the expected answer

Training Configuration

Dataset

• deyucao/dbbench-description-rewrites

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

model_id = "your_id/qwen3-4b-sql-grpo_202602221210_fin"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype=torch.float16,
    device_map="auto",
)

Sources & Terms

• Dataset: deyucao/dbbench-description-rewrites
• Users must comply with the base model's original terms of use.