Downloads · 30 days
21
42% of all-time downloads
appvoid_-_palmer-002-32k-awq
RichardErkhov/appvoid_-_palmer-002-32k-awq
appvoid_-_palmer-002-32k-awq is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
50
Public
Parameters
1.1B
766 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors766 MB · 99%
Parameter types
How the weights are stored.
I32969M · 88%
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
palmer-002-32k - AWQ
- Model creator: https://huggingface.co/appvoid/
- Original model: https://huggingface.co/appvoid/palmer-002-32k/
Original model description:
license: apache-2.0 language:
- en pipeline_tag: text-generation
palmer
a better base model
This model is palmer-002-2401 scaled to 32k by merging and fine-tuning with TinyLlama-1.1B-32k-Instruct by Doctor-Shotgun
evaluation 🧪
note that this is a zero-shot setting as opposite to open llm leaderboard's few-shot evals
model ARC-C OBQA HellaSwag PIQA Winogrande Average
tinyllama | 0.3029 | 0.3600 | 0.5935 | 0.7329 | 0.5959 | 0.5170 |
palmer-002-2401 | 0.3294 | 0.3700 | 0.5950 | 0.7399 | 0.5896 | 0.5247 |
palmer-002-32k | 0.3268 | 0.3780 | 0.5785 | 0.7492 | 0.6251 | 0.5315 | (this)
babbage-002 | 0.3285 | 0.3620 | 0.6380 | 0.7606 | 0.6085 | 0.5395 |
This model's performance is close to openai's one while being capable of using 2x the context size.
prompt 📝
no prompt 🚀
<a href="https://ko-fi.com/appvoid" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 48px !important;width: 180px !important; filter: invert(70%);" ></a>
- Type
- llama
- Created
- Dec 15, 2024
- Updated
- Dec 15, 2024