bkcare-bert-pretrained

<a name="introduction"></a> Bkcare-base-pretrained: Pre-trained Language Models for Vietnamese in Health Text Mining

bkcare-bert-pretrained is the a strong baseline language models for Vietnamese in Healthcare domain.

Example usage <a name="usage1"></a>

import torch
from transformers import AutoModel, AutoTokenizer

vihealthbert = AutoModel.from_pretrained("BookingCare/bkcare-bert-pretrained")
tokenizer = AutoTokenizer.from_pretrained("BookingCare/bkcare-bert-pretrained")

line = "Bệnh viện chợ rẫy ở Thành phố Hồ Chí Minh"

input_ids = torch.tensor([tokenizer.encode(line)])
with torch.no_grad():
    features = vihealthbert(input_ids)  # Models outputs are now tuples