Qwen3-4B-Instruct-2507-rewriter-gguf

Qwen3-4B-Instruct Text Rewriter (GGUF Format)

Example Notebook

🔗Kaggle notebook here

Model Description

This model is a fine-tuned version of Qwen3-4B-Instruct-2507, optimized specifically to rewrite AI-generated text into a more natural, human-like style. It was trained to reduce the "robotic" tone often found in LLM outputs while maintaining the original meaning and factual accuracy.

• Base Model: unsloth/Qwen3-4B-Instruct-2507 (merged from unsloth/Qwen3-4B-Instruct-2507-bnb-4bit)
• Fine-tuned by: Heatw4ve
• Fine-tuning Tool: Unsloth
• Quantization format: GGUF (Quantized to Q4_K_M)
• Training framework: Unsloth (LoRA-based SFT)
• Language: English
• Intended usage: Local inference, research, and experimentation

Training Details

The model was fine-tuned using LoRA (Low-Rank Adaptation) on a custom dataset of 28,000+ pairs of AI vs. Human-rewritten text.

Training Configuration

The model was fine-tuned with the following parameters:

• Epochs: 2
• Learning Rate: 5e-5
• Optimizer: AdamW 8-bit
• LR Scheduler: Cosine
• Warmup Steps: 100
• Context Length: 512 tokens
• LoRA Config: - Rank (r): 64
  • Alpha: 128
  • Target Modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
• Effective Batch Size: 128 (32 per device * 4 grad accumulation)

Usage

This is a GGUF version, compatible with LM Studio, Ollama, and llama.cpp. Works best with inputs of length 15-150 words.

System Prompt

To achieve the intended rewriting style, use the following system prompt:

You are a helpful assistant that rewrites AI-toned text into natural, human-like writing.

User Prompt Format

Rewrite the following text to sound like a real human wrote it:

[INSERT TEXT HERE]

Example Code

from llama_cpp import Llama
llm = Llama.from_pretrained(
  repo_id="Heatw4ve/Qwen3-4B-Instruct-2507-rewriter-gguf",
  filename="Qwen3-4B.gguf",
  n_ctx=4096,
  n_gpu_layers=16,
  n_threads=4,
  verbose=False,
  chat_format="chatml",
)

text='''
William Shakespeare, the master of human insight, gifted us with a timeless observation that cuts to the heart of intellect and humility: "The fool doth think he is wise, but the wise man knows himself to be a fool." Uttered by the character Touchstone in As You Like It, this seemingly paradoxical statement is far more than a witty quip; it's a profound commentary on self-awareness, the nature of true wisdom, and the perpetual quest for knowledge.
'''

messages = [
  {"role": "system", "content": "You are a helpful assistant that rewrites AI-toned text into natural, human-like writing."},
  {"role": "user", "content": f"Rewrite the following text to sound like a real human wrote it:\n\n{text}"}
]

output = llm.create_chat_completion(
  messages=messages,
  max_tokens=512,
  temperature=random.uniform(0.9, 1.2),
  top_p=random.uniform(0.87, 0.96),
  seed=random.randint(2, 2**32),
  stop=["<|im_end|>", "<|endoftext|>"]
)

print(output["choices"][0]["message"]["content"].strip())

🔗Connect with me on LinkedIn