Downloads · 30 days
14
5% of all-time downloads
akdeniz27/convbert-base-turkish-cased-ner-quantized
convbert-base-turkish-cased-ner-quantized is a token classification model from akdeniz27. Use it when you need labels on individual words, such as names. It is set up for transformers. The card lists the license as mit.
This model is the dynamically quantized version of the model (https://akdeniz27/convbert-base-turkish-cased-ner)
Downloads · 30 days
14
5% of all-time downloads
All-time downloads
277
Public
Repo size
193 MB
Likes
0
Public
Click a slice to open those files.
.onnx193 MB · 99%
From the Hugging Face model README
This model is the dynamically quantized version of the model (https://akdeniz27/convbert-base-turkish-cased-ner)
# First install "optimum[onnxruntime]":
!pip install "optimum[onnxruntime]"
# and import "ORTModelForTokenClassification":
from transformers import AutoTokenizer, pipeline
from optimum.onnxruntime import ORTModelForTokenClassification
model_onnx = ORTModelForTokenClassification.from_pretrained("akdeniz27/convbert-base-turkish-cased-ner-quantized", file_name="model_quantized.onnx")
tokenizer = AutoTokenizer.from_pretrained("akdeniz27/convbert-base-turkish-cased-ner-quantized")
ner = pipeline('ner', model=model, tokenizer=tokenizer, aggregation_strategy="first")
ner("your text here")
Pls refer (https://github.com/akdeniz27/dynamic_quantization) for details of quantization.