underscore2

llama3.2-3b-kto-rl-test-v3-stage5

underscore2/llama3.2-3b-kto-rl-test-v3-stage5

llama3.2-3b-kto-rl-test-v3-stage5 is a machine learning model from underscore2. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.

- Developed by: underscore2 - License: apache-2.0 - Finetuned from model : unsloth/llama-3.2-3b-Instruct-bnb-4bit