Downloads · 30 days
27
5% of all-time downloads
cp2024-instruct
cpayne1303/cp2024-instruct
cp2024-instruct is a text generation model from cpayne1303. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a model using the llama2 architecture and only 30 million parameters. It is based off of <a href = "https://huggingface.co/cpayne1303/cp2024"this model</a and was finetuned on approximately 85 million tokens o…
All-time downloads
492
Public
Parameters
31.2M
62.8 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors62.3 MB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Nov 27, 2024
- Updated
- Nov 28, 2024
- SHA
- e3649a85
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Model Description
This is a model using the llama2 architecture and only 30 million parameters. It is based off of <a href = "https://huggingface.co/cpayne1303/cp2024">this model</a> and was finetuned on approximately 85 million tokens of instruct data from the first 20000 rows of the openhermes 2.5 dataset with a low learning rate of 2e-6 and context length of 512.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 4.32 |
| IFEval (0-Shot) | 17.06 |
| BBH (3-Shot) | 2.48 |
| MATH Lvl 5 (4-Shot) | 0.00 |
| GPQA (0-shot) | 1.34 |
| MuSR (0-shot) | 3.18 |
| MMLU-PRO (5-shot) | 1.85 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Nov 27, 2024
- Updated
- Nov 28, 2024