Downloads · 30 days
0
xriminact/TarsDolly
TarsDolly is a text generation model from xriminact. Use it when you need the model to write or continue text. It is set up for adapter-transformers. The card lists the license as mit.
TarsDolly is FT on HuggingFaceH4/zephyr-7b-alpha using Dolly-15k dataset for general chat.
Downloads · 30 days
0
Access
Public
Updated Feb 2, 2024
Parameters
7.2B
14.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors14.5 GB · 100%
From the Hugging Face model README
TarsDolly is FT on HuggingFaceH4/zephyr-7b-alpha using Dolly-15k dataset for general chat.
Dolly-15k dataset was converted into chatml style for futher FT on zephyr-7b-beta model
epochs 4 batch_size 1 block_size 2096 lr 2e-4