Downloads · 30 days
2
4% of all-time downloads
frankenllama-16b-alpaca-noro
reallad/frankenllama-16b-alpaca-noro
frankenllama-16b-alpaca-noro is a text generation model from reallad. Use it when you need the model to write or continue text. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit.
All-time downloads
48
Public
Parameters
15B
30 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors30 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Apr 19, 2024
- Updated
- Apr 19, 2024
- SHA
- 0fa780d5
Try a prompt
Model card
From the Hugging Face model README
frankenllama-16b
This is a merge of pre-trained language models created using mergekit.
This is my personal frankenmerge of llama-3-8B after a light and unintentional tuning for 3 epochs on the noro dataset in Alpaca format. I have yet to test it or further tune it. So please don't take it too seriously.
Merge Details
Merge Method
This model was merged using the passthrough merge method.
Models Merged
The following models were included in the merge:
- reallad/llama-3-8b-alpaca-noro
Configuration
The following YAML configuration was used to produce this model:
slices:
- sources:
- model: reallad/llama-3-8b-alpaca-noro
layer_range: [0,32]
- sources:
- model: reallad/llama-3-8b-alpaca-noro
layer_range: [0,32]
merge_method: passthrough
dtype: bfloat16
tokenizer_source: base
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Apr 19, 2024
- Updated
- Apr 19, 2024