Downloads · 30 days
66
4% of all-time downloads
RichardErkhov/sonthenguyen_-_zephyr-sft-bnb-4bit-DPO-dismissive_mtbc-252steps-gguf
sonthenguyen_-_zephyr-sft-bnb-4bit-DPO-dismissive_mtbc-252steps-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
66
4% of all-time downloads
All-time downloads
1.8K
Public
Repo size
68.8 GB
Likes
0
Public
Click a slice to open those files.
.gguf77.4 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
zephyr-sft-bnb-4bit-DPO-dismissive_mtbc-252steps - GGUF
base_model: unsloth/zephyr-sft-bnb-4bit language:
TrainOutput(global_step=252, training_loss=0.0682461416144461, metrics={'train_runtime': 2060.2317, 'train_samples_per_second': 1.953, 'train_steps_per_second': 0.122, 'total_flos': 0.0, 'train_loss': 0.0682461416144461, 'epoch': 0.5009940357852882}) ==((====))== Unsloth - 2x faster free finetuning | Num GPUs = 1 \ /| Num examples = 8,046 | Num Epochs = 1 O^O/ _/ \ Batch size per device = 4 | Gradient Accumulation steps = 4 \ / Total batch size = 16 | Total steps = 252 "-____-" Number of trainable parameters = 41,943,040
This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.