Downloads · 30 days
11
3% of all-time downloads
boolq2.0
qinglinf/boolq2.0
boolq2.0 is a text classification model from qinglinf. Use it when you need a label for a piece of text. It is set up for transformers.
All-time downloads
368
Public
Repo size
7.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt2.8 GB · 67%
At a glance
- Task
- Text Classification
- Library
- transformers
- Model type
- roberta
- Access
- Public
- Created
- Apr 20, 2023
- Updated
- Apr 21, 2023
- SHA
- 6cba487a
Try a prompt
Model card
From the Hugging Face model README
Training parameters:
model_args = ClassificationArgs()
model_args.max_seq_length = 512
model_args.train_batch_size = 12
model_args.eval_batch_size = 12
model_args.num_train_epochs = 5
model_args.evaluate_during_training = False
model_args.learning_rate = 1e-5
model_args.use_multiprocessing = False
model_args.fp16 = False
model_args.save_steps = -1
model_args.save_eval_checkpoints = False
model_args.no_cache = True
model_args.reprocess_input_data = True
model_args.overwrite_output_dir = True
Evaluation on BoolQ Test Set:
| Precision | Recall | F1-score | |
|---|---|---|---|
| 0 | 0.82 | 0.80 | 0.81 |
| 1 | 0.88 | 0.89 | 0.88 |
| accuracy | 0.86 | ||
| macro avg | 0.85 | 0.84 | 0.85 |
| weighted avg | 0.86 | 0.86 | 0.86 |
ROC AUC Score: 0.844
- Task
- Text Classification
- Library
- transformers
- Type
- roberta
- Created
- Apr 20, 2023
- Updated
- Apr 21, 2023