Downloads · 30 days
74
12% of all-time downloads
athirdpath/Iambe-Storyteller-20b
Iambe-Storyteller-20b is a text generation model from athirdpath. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
<p align="center"<font size="7" <bDumb assistant, 🔥 author.</b</font</p <p align="center"<font size="5" <b4-bit Examples with Alpaca</b</font</p <p align="center"<img src="https://i.postimg.cc/VNXpwDCY/Screenshot-202…
Downloads · 30 days
74
12% of all-time downloads
All-time downloads
607
Public
Parameters
20B
40 GB on disk
Likes
13
Public
Click a slice to open those files.
.safetensors40 GB · 100%
From the Hugging Face model README
Thanks to Charles Goddard for the recipe.
The idea here is to "move" Iambe from being based on vanilla L2 to being based on sequelbox/DynamicFactor instead.
Because task_arithmetic uses the raw deltas, this should be similar to if the SFT had been done over DynamicFactor.
merge_method: task_arithmetic
base_model: athirdpath/BigLlama-20b-v1.1 # Base model you want to "move out" from
models:
model: athirdpath/Iambe-20b-DARE-v2 # SFTd model you want to transfer
model: athirdpath/DoubleFactor-20b # Base model you want to "move in" to
parameters:
dtype: bfloat16