Downloads · 30 days
5
16% of all-time downloads
dementor-research/dpo_gsm8k_nemotron-nano-30b-a3b_as_ministral-8b_seed42
dpo_gsm8k_nemotron-nano-30b-a3b_as_ministral-8b_seed42 is a machine learning model from dementor-research. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
LoRA adapter trained via Tinker as part of the dementor configuration-defined behavioral-imitation study.
Downloads · 30 days
5
16% of all-time downloads
All-time downloads
31
Public
Repo size
1.5 GB
Likes
0
Public
Click a slice to open those files.
.safetensors1.5 GB · 100%
From the Hugging Face model README
LoRA adapter trained via Tinker as part of the dementor configuration-defined behavioral-imitation study.
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16dpo_gsm8k_nemotron-nano-30b-a3b_as_ministral-8b_seed42from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = AutoModelForCausalLM.from_pretrained("nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16")
tok = AutoTokenizer.from_pretrained("nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16")
model = PeftModel.from_pretrained(base, "dementor-research/dpo_gsm8k_nemotron-nano-30b-a3b_as_ministral-8b_seed42")
The named campaign contains 12 models, 4 datasets, and
1 seed(s), yielding 528 configured cells for this stage. See
config.yaml in the code release for the exact cohort and hyperparameters.