Downloads · 30 days
39
5% of all-time downloads
palmer-002-32k
appvoid/palmer-002-32k
palmer-002-32k is a text generation model from appvoid. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is palmer-002-2401 scaled to 32k by merging and fine-tuning with TinyLlama-1.1B-32k-Instruct by Doctor-Shotgun
All-time downloads
761
Public
Parameters
1.1B
2.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jan 20, 2024
- Updated
- May 20, 2024
- SHA
- 99be1abc
Try a prompt
Model card
From the Hugging Face model README
palmer
a better base model
This model is palmer-002-2401 scaled to 32k by merging and fine-tuning with TinyLlama-1.1B-32k-Instruct by Doctor-Shotgun
evaluation 🧪
note that this is a zero-shot setting as opposite to open llm leaderboard's few-shot evals
model ARC-C OBQA HellaSwag PIQA Winogrande Average
tinyllama | 0.3029 | 0.3600 | 0.5935 | 0.7329 | 0.5959 | 0.5170 |
palmer-002-2401 | 0.3294 | 0.3700 | 0.5950 | 0.7399 | 0.5896 | 0.5247 |
palmer-002-32k | 0.3268 | 0.3780 | 0.5785 | 0.7492 | 0.6251 | 0.5315 | (this)
babbage-002 | 0.3285 | 0.3620 | 0.6380 | 0.7606 | 0.6085 | 0.5395 |
This model's performance is close to openai's one while being capable of using 2x the context size.
prompt 📝
no prompt 🚀
<a href="https://ko-fi.com/appvoid" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 48px !important;width: 180px !important; filter: invert(70%);" ></a>
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Jan 20, 2024
- Updated
- May 20, 2024