Downloads · 30 days
12
4% of all-time downloads
BigLlama-20b
athirdpath/BigLlama-20b
BigLlama-20b is a text generation model from athirdpath. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
I'm going to compare DARE merges using this (mostly vanilla, alpaca-tinted) 20b model vs using Harmonia.
All-time downloads
289
Public
Parameters
20B
40 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors40 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Model type
- llama
- Access
- Public
- Created
- Nov 29, 2023
- Updated
- Nov 29, 2023
- SHA
- 99e08457
Try a prompt
Model card
From the Hugging Face model README
I'm going to compare DARE merges using this (mostly vanilla, alpaca-tinted) 20b model vs using Harmonia.
slices:
- sources:
- model: athirdpath/alpaca-2-13b-english_full-model
- layer_range: [0, 16]
- sources:
- model: TheBloke/Llama-2-13B-fp16
- layer_range: [8, 24]
- sources:
- model: athirdpath/alpaca-2-13b-english_full-model
- layer_range: [17, 32]
- sources:
- model: TheBloke/Llama-2-13B-fp16
- layer_range: [25, 40]
merge_method: passthrough
dtype: float16
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Created
- Nov 29, 2023
- Updated
- Nov 29, 2023