Downloads · 30 days
101
1% of all-time downloads
eren23/DistiLabelOrca-TinyLLama-1.1B
DistiLabelOrca-TinyLLama-1.1B is a question answering model from eren23. Use it when the input is a question plus a passage. It is set up for transformers. The card lists the license as apache-2.0.
TinyLlama/TinyLlama-1.1B-Chat-v1.0 dpo finetuned on the argilla/distilabel-intel-orca-dpo-pairs dataset, which is the distilled version of https://huggingface.co/datasets/Intel/orcadpopairs
Downloads · 30 days
101
1% of all-time downloads
All-time downloads
12.7K
Public
Parameters
1.1B
2.2 GB on disk
Likes
3
Public
Click a slice to open those files.
.safetensors2.2 GB · 100%
From the Hugging Face model README
TinyLlama/TinyLlama-1.1B-Chat-v1.0 dpo finetuned on the argilla/distilabel-intel-orca-dpo-pairs dataset, which is the distilled version of https://huggingface.co/datasets/Intel/orca_dpo_pairs
GGUF Version: To be added Exllama Version: To be added
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 37.17 |
| AI2 Reasoning Challenge (25-Shot) | 36.18 |
| HellaSwag (10-Shot) | 61.15 |
| MMLU (5-Shot) | 25.09 |
| TruthfulQA (0-shot) | 38.05 |
| Winogrande (5-shot) | 60.85 |
| GSM8k (5-shot) | 1.67 |