Qwen2.5-3B-Deconstruct-V2.4

Example Inference Code

# --- INFERENCE TEST (Qwen 3B - Tetralemma V2) ---
from unsloth import FastLanguageModel


FastLanguageModel.for_inference(model)


test_question = "You're Hedge fund manager, with AUM of $1000000000. how would you structure your financial portofolio?"


v2_system_prompt = """You are a Deconstructionist Analyst.
User Question: {}
Deconstruction Analysis:"""

prompt = v2_system_prompt.format(test_question)

inputs = tokenizer([prompt], return_tensors = "pt").to("cuda")

# Generate
outputs = model.generate(
    **inputs, 
    max_new_tokens = 4096, 
    use_cache = True,
    temperature = 0.7, 
    top_p = 0.9,
)

# Decode Result
print("\n--- Qwen Thinking (Qwen 2.5-3B) ---")
# Strip prompt for cleaness
print(tokenizer.decode(outputs[0]).split("Deconstruction Analysis:")[-1].replace("<|endoftext|>", ""))

Uploaded model

• Developed by: RinKana
• License: apache-2.0
• Finetuned from model : unsloth/qwen2.5-3b-instruct-bnb-4bit

This qwen2 model was trained 2x faster with Unsloth

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>