Downloads · 30 days
18.1K
1% of all-time downloads
bert-mini-finetune-question-detection
shahrukhx01/bert-mini-finetune-question-detection
bert-mini-finetune-question-detection is a text classification model from shahrukhx01. Use it when you need a label for a piece of text. It is set up for transformers.
Trained to add feature for classifying queries between Keyword Query or Question + Statement Query using classification in Haystack
All-time downloads
1.5M
Public
Parameters
11.2M
89.4 MB on disk
Likes
18
Public
Repo makeup
Click a slice to open those files.
.bin44.7 MB · 50%
Parameter types
How the weights are stored.
F3211.2M · 100%
Try a prompt
Model card
From the Hugging Face model README
KEYWORD QUERY VS STATEMENT/QUESTION CLASSIFIER FOR NEURAL SEARCH
| Train Loss | Validation Acc. | Test Acc. |
|---|---|---|
| 0.000806 | 0.99 | 0.997 |
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("shahrukhx01/bert-mini-finetune-question-detection")
model = AutoModelForSequenceClassification.from_pretrained("shahrukhx01/bert-mini-finetune-question-detection")
Trained to add feature for classifying queries between Keyword Query or Question + Statement Query using classification in Haystack
Problem Statement: One common challenge that we saw in deployments: We need to distinguish between real questions and keyword queries that come in. We only want to route questions to the Reader branch in order to maximize the accuracy of results and minimize computation efforts/costs.
Baseline: https://www.kaggle.com/shahrukhkhan/question-v-statement-detection
Dataset: https://www.kaggle.com/stefanondisponibile/quora-question-keyword-pairs
Kaggle Notebook: https://www.kaggle.com/shahrukhkhan/question-vs-statement-classification-mini-bert/
- Task
- Text Classification
- Library
- transformers
- Type
- bert
- Languages
- en
- Hf Inference
- live
- Created
- Mar 2, 2022
- Updated
- Mar 29, 2023