Downloads · 30 days
54
8% of all-time downloads
bhuvana-ak7/OrpoLlama-3.2-1B-V1_q4_k_m
OrpoLlama-3.2-1B-V1_q4_k_m is a text generation model from bhuvana-ak7. Use it when you need the model to write or continue text. It is set up for transformers.
This model is a quantized version of bhuvana-ak7/OrpoLlama-3.2-1B-V1. OrpoLlama-3.2-1B-V1 model is a fine-tuned version of meta-llama/Llama-3.2-1B, using ORPO (Optimized Regularization for Prompt Optimization) Trainer…
Downloads · 30 days
54
8% of all-time downloads
All-time downloads
720
Public
Parameters
1.2B
5.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.gguf3.3 GB · 56%
From the Hugging Face model README
This model is a quantized version of bhuvana-ak7/OrpoLlama-3.2-1B-V1. OrpoLlama-3.2-1B-V1 model is a fine-tuned version of meta-llama/Llama-3.2-1B, using ORPO (Optimized Regularization for Prompt Optimization) Trainer. This model is fine-tuned using the mlabonne/orpo-dpo-mix-40k dataset. Only 1000 data samples were used to train quickly using ORPO.
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| hellaswag | 1 | none | 0 | acc | ↑ | 0.4772 | ± | 0.0050 |
| none | 0 | acc_norm | ↑ | 0.6366 | ± | 0.0048 |
| Tasks | Metric | Base Model | Quantized Model | Changed |
|---|---|---|---|---|
| hellaswag | acc | 0.4772 | 0.4772 | No |
| hellaswag | acc_norm | 0.6366 | 0.6366 | No |