BloomVN-8B-Chat-Reasoning

<div align="center"> <img src="https://github.com/bloomifycafe/blossomsAI/blob/main/assets/logo.png?raw=true" alt="Logo"/> </div> </br> <div align="center">

🌟 BloomVN-8B-Chat-Reasoning

</div>

A fine-tuned multilingual model for Vietnamese reasoning

NOTE

• This model is a test version for our new training pipeline. THIS IS NOT SUITABLE FOR PRODUCTION
• The full model will be updated soon.

📋 Overview

• A language model with reasoning capability that provides step-by-step reasoning in Vietnamese before delivering answers.
• The model follows a structured XML format with explicit reasoning tags.
• It's designed for educational applications and complex problem-solving tasks in Vietnamese.

🔧 Method

• Fine-tuned using Group Relative Policy Optimization (GRPO) with Unsloth for hardware efficiency.
• Employs rule-based reward functions to encourage adherence to Vietnamese XML reasoning format.
• Uses LoRA adaptation on a Vietnamese dataset spanning various task types.

💫 Quantization

Coming Soon!

🤝 Contributors

Developed with ❤️ by BlossomAI

<p align="left"> <img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/made with unsloth.png" width="200" /> </p>

---

<div align="center"> _{Star ⭐️ this repo if you find it valuable!} </div>