Downloads · 30 days
10
16% of all-time downloads
cgato/Nemo-12b-Toveri-v0.1
Nemo-12b-Toveri-v0.1 is a machine learning model from cgato. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
A model made with curated synthetic data and then KTO'd on a small curated set. Total time to train was 4 H100 hours. I quite like the results this gave despite the dataset sizes involved. Its also a lot cheaper to it…
Downloads · 30 days
10
16% of all-time downloads
All-time downloads
64
Public
Parameters
12.2B
24.5 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors24.5 GB · 100%
From the Hugging Face model README
A model made with curated synthetic data and then KTO'd on a small curated set. Total time to train was 4 H100 hours. I quite like the results this gave despite the dataset sizes involved. Its also a lot cheaper to iterate. I plan to hand review the human data I've been using and slowly work that back into the datamix. Additionally, planning to make a focused instruction following KTO set to improve system prompt adherance and steerability.
Use chatML and minP.