Qwen3-1.7B-R1

Qwen3-1.7B-R1

Qwen3-1.7B-R1 is a LoRA fine-tuned version of huihui-ai/Qwen3-1.7B-abliterated on the agentlans/train-of-thought 100K split. It answers queries directly by default but supports chain-of-thought (CoT) reasoning when prompted with a system message like:

Explain your reasoning step-by-step using <think>...</think>, then give the final answer inside <response>...</response>.

Examples

This model gives seemingly impressive answers but it has many problems as the examples below show.

Prompt:

Which is bigger: Venus or Earth?

Without long CoT:

Venus is larger than Earth.

- Earth's diameter: Approximately 12,742 km
- Venus's diameter: About 12,103 km

Venus's equatorial circumference is slightly smaller than Earth's, and it is the second-largest planet in our solar system. This size difference contributes to Venus's unique features, such as its thick atmosphere and intense greenhouse effect, which lead to its extreme surface temperatures.

With long CoT:

<think>Okay, so the user is asking which is bigger between Venus and Earth. Hmm, let me think. I remember from school that Venus is a planet, and Earth is the one we live on. But wait, what are their sizes compared to each other?

First, I should recall the order of the planets in the solar system. Venus is the second planet from the Sun, but it's smaller than Earth. Wait, no, actually, Earth is the third planet. Venus is closer to the Sun, so it's larger than Earth. But I'm not 100% sure. Let me check my memory. Venus's diameter is about 12,104 kilometers. Earth's is about 12,742 kilometers. So Venus is smaller, right? So that means Venus is smaller than Earth. So the answer should be that Venus is smaller than Earth. But maybe I should double-check to make sure I'm not mixing up anything. Sometimes I get confused between Mercury and Venus in terms of size. Mercury is even smaller, but Venus is larger than Mercury. So yes, Venus is smaller. The user might be interested in knowing the exact numbers or maybe the context of being a planet. Also, sometimes people might confuse the Earth's size with Venus's because they both orbit the Sun, but in reality, their actual sizes are different. So the correct answer is that Venus is smaller than Earth.</think>
<response>Venus is smaller than Earth. Here's the breakdown:

- Venus's diameter: Approximately 12,104 kilometers (7,521 miles).
- Earth's diameter: About 12,742 kilometers (7,926 miles).

Venus orbits the Sun in just 183 days (about 243 Earth days), but it's the largest of the inner planets (along with Mercury). Earth, in contrast, is the largest planet in our solar system and the only one with liquid water and life. 🌍🔥</response>

Limitations

• Factual errors (the largest planet in our solar system)
• Irrelevant thoughts and answers (atmospheric composition and orbital period)
• Partially correct answers (Earth is larger than Venus but Earth is the largest planet)
• At times, poor reasoning (something like "Venus is larger than Earth which means Earth is larger than Venus")
• Correct answer but faulty reasoning ("Earth is the only planet that supports life. Therefore, Earth is larger than Venus.")
• Wild variations between runs
• Partly censored/uncensored

Key Training Settings

• bf16 precision, cutoff length 2048
• LoRA fine-tuning: rank 16, alpha 32, dropout 0
• Learning rate: 5e-5 with cosine scheduler
• Gradient accumulation steps: 8, batch size: 1
• Flash attention (fa2), neat packing enabled
• One epoch over 100K samples
• Optimizer: AdamW (PyTorch)
• Warmup steps: 0

Licence

Apache 2.0