underscore2

llama3.2-1b-kto-rl-test-v2-stage3

underscore2/llama3.2-1b-kto-rl-test-v2-stage3

llama3.2-1b-kto-rl-test-v2-stage3 is a machine learning model from underscore2. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.

- Developed by: underscore2 - License: apache-2.0 - Finetuned from model : unsloth/Llama-3.2-1B-Instruct-bnb-4bit