siwon-mini-instruct-0626

<p align="center"> <img src="https://cdn-uploads.huggingface.co/production/uploads/665818433a098887a5b95015/IlaWEzz4UrH7d14DkXGgQ.png" width="300" height="300"> </p>

siwon-mini-instruct-0626

This model is a fine-tuned version of microsoft/Phi-4-mini-instruct, adapted for Korean instruction-based tasks. The tuning was focused on enhancing Korean performance through supervised fine-tuning with Korean instruction datasets.

---

🔧 Token Adjustments

The original model used the same token ID (199999) for multiple special tokens such as BOS, EOS, PAD, and UNK. This caused confusion in instruction-following tasks. We fixed this by remapping the token IDs as follows:

These changes ensure proper differentiation and functioning of special tokens during generation and training.

---

🗨️ Chat Template

The chat template was updated accordingly to support multi-turn conversation formatting in the Korean context:

{% for message in messages %}
{% if message['role'] == 'system' and 'tools' in message and message['tools'] is not none %}
{{ '<|' + message['role'] + '|>' + message['content'] + '<|tool|>' + message['tools'] + '<|/tool|>' + '<|end|>' }}
{% else %}
{{ '<|' + message['role'] + '|>' + message['content'] + '<|end|>' }}
{% endif %}
{% endfor %}
{% if add_generation_prompt %}{{ '<|assistant|>' }}{% endif %}

🧪 Inference with Transformers

Below is an example of how to load and use the model with the adjusted tokenizer, token IDs, and custom prompt template.

Note: This model uses a custom chat_template and updated special token IDs:

• <|end|> → 200020 (EOS)
• <|dummy_85|> → 200029 (PAD)
• � → 200030 (UNK)

from transformers import AutoTokenizer, AutoModelForCausalLM

model_path = "IamMcCoy/siwon-mini-instruct-0626"

model = AutoModelForCausalLM.from_pretrained(
    model_path,
    device_map="auto",
    torch_dtype=torch.bfloat16,
    trust_remote_code=True
)

tokenizer = AutoTokenizer.from_pretrained(
    model_path,
    trust_remote_code=True,
)

messages = [
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "안녕하세요."},
    ]

inputs = tokenizer.apply_chat_template(messages, return_tensors="pt").to(model.device)

output = model.generate(
    **inputs,
    max_new_tokens=2048,
    # do_sample=True, # Optional
    # top_p=0.95, # Optional
    # temperature=0.6, # Optional
    # repetition_penalty=1.1, # Optional
)

response = tokenizer.decode(output[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True)
print(response)

📊 Model Performance Comparison

Performance scores across three Korean language benchmarks (KMMLU, ko_best, pawsx_ko).

📌 Caution

• Commercial use is strictly prohibited.

• This model is intended for research and educational use only.

• Redistribution or use in commercial products or services is not allowed.

✍️ Acknowledgments

• Base model: microsoft/Phi-4-mini-instruct
• Special thanks to the open-source community for instruction-tuning resources and Korean language corpora.

🙏 Feedback & Contributions

We welcome any feedback to improve the model’s performance, usability, and alignment with Korean instruction tasks. If you encounter any issues or have suggestions, please feel free to open an issue on the Hugging Face model page.

Your input is greatly appreciated and will help us enhance the model further.