Downloads · 30 days
22
9% of all-time downloads
roberta-large-openai-detector-onnx-fp16
joaopn/roberta-large-openai-detector-onnx-fp16
roberta-large-openai-detector-onnx-fp16 is a text classification model from joaopn. Use it when you need a label for a piece of text. The card lists the license as mit.
This model is a FP16 optimized version of openai-community/roberta-large-openai-detector. It runs exclusively on the GPU. The speedup compared to the base ONNX and pytorch versions depends chiefly on your GPU's FP16:F…
All-time downloads
250
Public
Repo size
711 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.onnx711 MB · 100%
At a glance
- Task
- Text Classification
- License
- mit
- Model type
- roberta
- Access
- Public
- Created
- Sep 29, 2024
- Updated
- Sep 29, 2024
- SHA
- 52425baf
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
RoBERTa Large OpenAI Detector
This model is a FP16 optimized version of openai-community/roberta-large-openai-detector. It runs exclusively on the GPU. The speedup compared to the base ONNX and pytorch versions depends chiefly on your GPU's FP16:FP32 ratio. For more comparison benchmarks and sample code of a related model, check here: https://github.com/joaopn/gpu_benchmark_goemotions.
You will need the GPU version of the ONNX Runtime. It can be installed with
pip install optimum[onnxruntime-gpu] --extra-index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-cuda-12/pypi/simple/
For convenience, this benchmark repo provides an environment.yml file to create a conda env with all the requirements.
- Task
- Text Classification
- Type
- roberta
- License
- mit
- Languages
- en
- Created
- Sep 29, 2024
- Updated
- Sep 29, 2024