Downloads · 30 days
7
12% of all-time downloads
TinyOncBert-1225
ksg-dfci/TinyOncBert-1225
TinyOncBert-1225 is a machine learning model from ksg-dfci. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
This is a 'tiny' masked language model fine-tuned on synthetic oncology clinical text from prajjwal1/bert-tiny as a preparatory step to training TinyBertOncoTagger.
All-time downloads
57
Public
Parameters
4.4M
17.7 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors17.7 MB · 95%
At a glance
- License
- cc-by-nc-4.0
- Model type
- bert
- Access
- Public
- Created
- Dec 14, 2025
- Updated
- Dec 16, 2025
- SHA
- e91bd45b
Base models
Model card
From the Hugging Face model README
This is a 'tiny' masked language model fine-tuned on synthetic oncology clinical text from prajjwal1/bert-tiny as a preparatory step to training TinyBertOncoTagger.
Training data: https://huggingface.co/datasets/ksg-dfci/mmai-synthetic/blob/main/all_synthetic_notes.parquet
Training script: https://github.com/kenlkehl/matchminer-ai-training/blob/main/3b_train_tiny_oncbert.py
Training script call:
accelerate launch 3b_train_tiny_oncbert.py
--data trial_space_lineitems.csv:trial_text
trial_space_lineitems.csv:this_space
trial_space_lineitems.csv:trial_boilerplate_text
all_synthetic_notes.parquet:synthetic_note
--output_dir ./onc_bert_tiny
--per_device_train_batch_size 64
- Type
- bert
- License
- cc-by-nc-4.0
- Created
- Dec 14, 2025
- Updated
- Dec 16, 2025