Downloads · 30 days
0
athirdpath/Iambe-Storyteller-20b-GGUF
Iambe-Storyteller-20b-GGUF is a machine learning model from athirdpath. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
<p align="center"<font size="7" <bDumb assistant, 🔥 author.</b</font</p <p align="center"<font size="5" <b4-bit Examples with Alpaca</b</font</p <p align="center"<img src="https://i.postimg.cc/VNXpwDCY/Screenshot-202…
Downloads · 30 days
0
Access
Public
Updated Dec 7, 2023
Repo size
91.8 GB
Likes
5
Public
Click a slice to open those files.
.bin91.8 GB · 100%
From the Hugging Face model README
Thanks to Charles Goddard for the recipe.
The idea here is to "move" Iambe from being based on vanilla L2 to being based on sequelbox/DynamicFactor instead.
Because task_arithmetic uses the raw deltas, this should be similar to if the SFT had been done over DynamicFactor.
merge_method: task_arithmetic
base_model: athirdpath/BigLlama-20b-v1.1 # Base model you want to "move out" from
models:
model: athirdpath/Iambe-20b-DARE-v2 # SFTd model you want to transfer
model: athirdpath/DoubleFactor-20b # Base model you want to "move in" to
parameters:
dtype: bfloat16