Downloads · 30 days
20
26% of all-time downloads
palmer-002-2401
appvoid/palmer-002-2401
palmer-002-2401 is a text generation model from appvoid. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a small improvement over a (now un-prompted zyte) tinyllama model
All-time downloads
77
Public
Repo size
4.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin2.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jan 16, 2024
- Updated
- Jan 17, 2024
- SHA
- fd7a4f11
Try a prompt
Datasets
Model card
From the Hugging Face model README
palmer
a better base model
This is a small improvement over a (now un-prompted zyte) tinyllama model
evaluation 🧪
note that this is a zero-shot setting as opposite to open llm leaderboard's few-shot evals
model ARC-C OBQA HellaSwag PIQA Winogrande Average
tinyllama | 0.3029 | 0.3600 | 0.5935 | 0.7329 | 0.5959 | 0.5170 |
palmer-002 | 0.3242 | 0.3700 | 0.5956 | 0.7345 | 0.5888 | 0.5226 |
palmer-002-2401 | 0.3294 | 0.3700 | 0.5950 | 0.7399 | 0.5896 | 0.5247 | (this)
babbage-002 | 0.3285 | 0.3620 | 0.6380 | 0.7606 | 0.6085 | 0.5395 |
training 🦾
Training took ~1 A100 gpu hour. It was trained on 50,000 gpt-4 shuffled samples. palmer was fine-tuned using lower learning rates ensuring it keeps as much general knowledge as possible.
prompt 📝
no prompt 🚀
<a href="https://ko-fi.com/appvoid" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 48px !important;width: 180px !important; filter: invert(70%);" ></a>
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Jan 16, 2024
- Updated
- Jan 17, 2024