Downloads · 30 days
15
3% of all-time downloads
BerKANT_171M
isemmanuelolowe/BerKANT_171M
BerKANT_171M is a fill-mask model from isemmanuelolowe. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
A Bert implementation where most of the torch.nn.linear have been replaced with KANLinear.
All-time downloads
463
Public
Parameters
171M
11.3 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors686 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- mit
- Model type
- bert
- Access
- Public
- Created
- May 12, 2024
- Updated
- May 14, 2024
- SHA
- dfc93130
Try a prompt
Model card
From the Hugging Face model README
BerKANT (training)
A Bert implementation where most of the torch.nn.linear have been replaced with KANLinear.
Currently pretraining on JackBAI/bert_pretrain_datasets on a RTX 4090. Will be do in 5 days from 13/05/2024. Until then :)
from transformers import AutoModelForMaskedLM, AutoConfig
# Define the model path
model_path = "isemmanuelolowe/BerKANT_171M"
# Load the configuration
config = AutoConfig.from_pretrained(model_path)
# Load the model with the correct configuration
model = AutoModelForMaskedLM.from_pretrained(model_path, config=config, trust_remote_code=True)
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- mit
- Languages
- en
- Created
- May 12, 2024
- Updated
- May 14, 2024