Downloads · 30 days
24
9% of all-time downloads
CorDA_KPA_nqopen_finetuned_math
iboing/CorDA_KPA_nqopen_finetuned_math
CorDA_KPA_nqopen_finetuned_math is a text generation model from iboing. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
The LLaMA-2-7b model finetuned on the Math task using CorDA in the KPA mode with nqopen.
All-time downloads
261
Public
Parameters
7.1B
14.1 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors14.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Model type
- llama
- Access
- Public
- Created
- Jul 11, 2024
- Updated
- Jul 14, 2024
- SHA
- 57402386
Try a prompt
Model card
From the Hugging Face model README
The LLaMA-2-7b model finetuned on the Math task using CorDA in the KPA mode with nqopen.
| Method | TriviaQA | NQ open | GSM8k | Math |
|---|---|---|---|---|
| LoRA | 44.17 | 1.91 | 42.68 | 5.92 |
| CorDA (KPA with nqopen) | 45.23 | 10.44 | 45.64 | 6.94 |
| CorDA (IPA with MetaMath) | - | - | 54.59 | 8.54 |
You can evaluate the model's performance following the step-3 in CorDA github repo.
Note: The model trained using CorDA adapter is based on customized code. If you want to restore the original LLaMA architecture, execute merge_adapter_for_corda.py in CorDA github repo.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Created
- Jul 11, 2024
- Updated
- Jul 14, 2024