Downloads · 30 days
8
0% of all-time downloads
entropy/roberta_zinc_compression_head
roberta_zinc_compression_head is a machine learning model from entropy. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This model is trained to compress embeddings generated by the robertazinc480m model from the native size of 768 to compressed sizes 512, 256, 128, 64, and 32.
Downloads · 30 days
8
0% of all-time downloads
All-time downloads
1.7K
Public
Parameters
2.6M
10.6 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors10.6 MB · 100%
From the Hugging Face model README
This model is trained to compress embeddings generated by the roberta_zinc_480m model from the native size of 768 to compressed sizes 512, 256, 128, 64, and 32.
The compressed embeddings are trained to maintain cosine similarity computed using the native embeddings.