Downloads · 30 days
2
7% of all-time downloads
aldigobbler/rwkv-embed-head-transfomer-125k-6M
rwkv-embed-head-transfomer-125k-6M is a machine learning model from aldigobbler. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
2
7% of all-time downloads
All-time downloads
28
Public
Repo size
26.8 MB
Likes
0
Public
Click a slice to open those files.
.pth26.8 MB · 98%
From the Hugging Face model README

test rwkv embed head
6m params roughly
internal benchmark results (~10-25 tokens)
Q&A Performance:
Top-1 Accuracy: 18/25 = 72.00%
Top-3 Recall: 19/25 = 76.00%
OOD Rejection: 0/4 = 0.00%
Similarity Performance:
Top-1 Accuracy: 9/25 = 36.00%
Top-3 Recall: 14/25 = 56.00%
OOD Rejection: 0/4 = 0.00%
Overall Performance:
Top-1 Accuracy: 27/50 = 54.00%
Top-3 Recall: 33/50 = 66.00%
OOD Rejection: 0/8 = 0.00%