BloomVN-0.5B-ppo

<div align="center"> <img src="https://github.com/bloomifycafe/blossomsAI/blob/main/assets/logo.png?raw=true" alt="Logo"/> </div> </br> <div align="center">

🌟 BloomVN-0.5B-ppo

</div>

A fine-tuned multilingual model for Vietnamese language

📋 Overview

This model serves as a small-scale experiment (0.5B parameters) testing the Reinforcement Learning capabilities of veRL framework. The implementation uses PPO (Proximal Policy Optimization) method on a limited training dataset to evaluate veRL's performance and training behavior.

🔧 Method

The experimentation process was conducted using veRL, focusing on:

• Implementation of PPO algorithm with a 0.5B parameter model
• Running training experiments on a small dataset
• Testing veRL's framework capabilities in handling RL tasks
• Evaluating training efficiency and model behavior

This lightweight approach allowed us to assess veRL's performance in a controlled, small-scale environment.

📊 VLMU Benchmark

🤝 Contributors

Developed with ❤️ by BlossomAI

---

<div align="center"> _{Star ⭐️ this repo if you find it valuable!} </div>