Downloads · 30 days
5.2K
4% of all-time downloads
refutation_detector_distilbert
leondz/refutation_detector_distilbert
refutation_detector_distilbert is a text classification model from leondz. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as cc-by-4.0.
These are responses designed to capture a model refuting a false claim.
All-time downloads
142K
Public
Parameters
67M
1.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin268 MB · 50%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- cc-by-4.0
- Model type
- distilbert
- Access
- Public
- Created
- Jun 2, 2023
- Updated
- Aug 27, 2024
- SHA
- dfb68742
Try a prompt
Model card
From the Hugging Face model README
These are responses designed to capture a model refuting a false claim.
They're prompt results of OpenAI gpt-3.5-turbo run on June 1 2023. Prompts are constructed by prepending "Explain why" to claims made in the True-False dataset provided alongside The Internal State of an LLM Knows When its Lying. Only the first sentence of the response is included (from nltk.sent_tokenize).
The original labels are used, where 0 corresponds to a false claim. That is, the 0 labels should be almost all refutations.
Spurious and missing refutations were removed by hand, corresponding to about 10% of the data. This were caused by either an incorrect model assertion, or errors in the source data.
- Task
- Text Classification
- Library
- transformers
- Type
- distilbert
- License
- cc-by-4.0
- Languages
- en
- Created
- Jun 2, 2023
- Updated
- Aug 27, 2024