Downloads · 30 days
40
43% of all-time downloads
llm_uplimit_P2_llama3
JPBianchi/llm_uplimit_P2_llama3
llm_uplimit_P2_llama3 is a text generation model from JPBianchi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.2.
This model is a fine-tuned variant of Llama-3.2-1B, leveraging ORPO (Optimized Regularization for Prompt Optimization) for enhanced performance. It has been fine-tuned using the mlabonne/orpo-dpo-mix-40k dataset as pa…
All-time downloads
92
Public
Repo size
2.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json52.7 KB · 94%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3.2
- Model type
- llama
- Access
- Public
- Created
- Nov 3, 2024
- Updated
- Nov 3, 2024
- SHA
- ef1465c4
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Model Overview
This model is a fine-tuned variant of Llama-3.2-1B, leveraging ORPO (Optimized Regularization for Prompt Optimization) for enhanced performance. It has been fine-tuned using the mlabonne/orpo-dpo-mix-40k dataset as part of the Finetuning Open Source LLMs Course - Week 2 Project.
Intended Use
This model is optimized for general-purpose language tasks, including text parsing, understanding contextual prompts, and enhanced interpretability in natural language processing applications.
Evaluation Results
The model was evaluated on the following benchmarks, with the following performance metrics:
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| eq_bench | 2.1 | none | 0 | eqbench | ↑ | 1.5355 | ± | 0.9184 |
| none | 0 | percent_parseable | ↑ | 16.9591 | ± | 2.8782 | ||
| hellaswag | 1 | none | 0 | acc | ↑ | 0.4812 | ± | 0.0050 |
| none | 0 | acc_norm | ↑ | 0.6467 | ± | 0.0049 | ||
| ifeval | 4 | none | 0 | inst_level_loose_acc | ↑ | 0.3984 | ± | N/A |
| none | 0 | inst_level_strict_acc | ↑ | 0.2974 | ± | N/A | ||
| none | 0 | prompt_level_loose_acc | ↑ | 0.2755 | ± | 0.0193 | ||
| none | 0 | prompt_level_strict_acc | ↑ | 0.1848 | ± | 0.0168 | ||
| tinyMMLU | 0 | none | 0 | acc_norm | ↑ | 0.3995 | ± | N/A |
Key Features
- Model Size: 1 Billion parameters
- Fine-tuning Method: ORPO
- Dataset: mlabonne/orpo-dpo-mix-40k
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3.2
- Languages
- en
- Created
- Nov 3, 2024
- Updated
- Nov 3, 2024