Downloads · 30 days
42
34% of all-time downloads
polodealvarado/dynquery
dynquery is a zero-shot classification model from polodealvarado. Use it when you need labels you did not train the model on. It is set up for transformers. The card lists the license as mit.
DyREx-inspired dynamic label queries via cross-attention over text tokens.
Downloads · 30 days
42
34% of all-time downloads
All-time downloads
122
Public
Parameters
112M
447 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors447 MB · 100%
From the Hugging Face model README
DyREx-inspired dynamic label queries via cross-attention over text tokens.
This model encodes texts and candidate labels into a shared embedding space using BERT, enabling classification into arbitrary categories without retraining for new labels.
| Parameter | Value |
|---|---|
| Base model | bert-base-uncased |
| Model variant | dynquery |
| Training steps | 1000 |
| Batch size | 2 |
| Learning rate | 2e-05 |
| Trainable params | 111,844,608 |
| Training time | 383.0s |
Trained on polodealvarado/zeroshot-classification.
| Metric | Score |
|---|---|
| Precision | 0.7704 |
| Recall | 0.9773 |
| F1 Score | 0.8616 |
from models.dynquery import DynQueryModel
model = DynQueryModel.from_pretrained("polodealvarado/dynquery")
predictions = model.predict(
texts=["The stock market crashed yesterday."],
labels=[["Finance", "Sports", "Biology", "Economy"]],
)
print(predictions)
# [{"text": "...", "scores": {"Finance": 0.98, "Economy": 0.85, ...}}]