Downloads · 30 days
11
3% of all-time downloads
vikhr_nemo_orpo_dostoevsky_12b
IlyaGusev/vikhr_nemo_orpo_dostoevsky_12b
vikhr_nemo_orpo_dostoevsky_12b is a machine learning model from IlyaGusev. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for unsloth. The card lists the license as apache-2.0.
Vikhr-Nemo fine-tuned with contrastive Russian literature.
All-time downloads
351
Public
Parameters
12.2B
24.5 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors24.5 GB · 100%
At a glance
- Library
- unsloth
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Oct 6, 2024
- Updated
- Oct 7, 2024
- SHA
- 86ce10d3
Base models
Datasets
Model card
From the Hugging Face model README
Vikhr-Nemo fine-tuned with contrastive Russian literature.
- Base model: https://huggingface.co/Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24
- Dataset: https://huggingface.co/datasets/40umov/dostoevsky
- Method: ORPO
- Training config: https://github.com/IlyaGusev/saiga/blob/main/configs/models/doestoevsky_nemo_12b_orpo_m1.json
- WandB: https://wandb.ai/ilyagusev/rulm_self_instruct/runs/4v4pcgej
- Library
- unsloth
- Type
- mistral
- License
- apache-2.0
- Languages
- ru
- Created
- Oct 6, 2024
- Updated
- Oct 7, 2024