Downloads · 30 days
11
34% of all-time downloads
palmer-instruct-test-14
appvoid/palmer-instruct-test-14
palmer-instruct-test-14 is a text generation model from appvoid. Use it when you need the model to write or continue text. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit.
All-time downloads
32
Public
Parameters
1.1B
2.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Apr 18, 2024
- Updated
- Apr 18, 2024
- SHA
- dd68f388
Try a prompt
Base models
Model card
From the Hugging Face model README
merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the TIES merge method using TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T
#no parameters necessary for base model
- model: vihangd/DopeyTinyLlama-1.1B-v1
parameters:
density: 0.10
weight: 0.60
- model: l3utterfly/tinyllama-1.1b-layla-v4
parameters:
density: 0.39
weight: 0.50
- model: appvoid/palmer-003
parameters:
density: 0.60
weight: 0.40
merge_method: ties
base_model: TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T
parameters:
normalize: true
int8_mask: true
dtype: float16
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Apr 18, 2024
- Updated
- Apr 18, 2024