Downloads · 30 days
20
16% of all-time downloads
cygu/pythia-1.4b-sampling-watermark-distill-kgw-k0-gamma0.25-delta1
pythia-1.4b-sampling-watermark-distill-kgw-k0-gamma0.25-delta1 is a text generation model from cygu. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Sampling-based watermark distilled Pythia 1.4B using the KGW \\(k=0, \gamma=0.25, \delta=1\\) watermarking strategy in the paper On the Learnability of Watermarks for Language Models.
Downloads · 30 days
20
16% of all-time downloads
All-time downloads
126
Public
Parameters
1.5B
12.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.bin5.8 GB · 46%
How the weights are stored.
F321.4B · 93%
From the Hugging Face model README
Sampling-based watermark distilled Pythia 1.4B using the KGW \(k=0, \gamma=0.25, \delta=1\) watermarking strategy in the paper On the Learnability of Watermarks for Language Models.
The following hyperparameters were used during training: