Downloads · 30 days
10
16% of all-time downloads
transhumanist-already-exists/gene-r1-1b-bio-focus-go-2400rows
gene-r1-1b-bio-focus-go-2400rows is a text generation model from transhumanist-already-exists. Use it when you need the model to write or continue text. It is set up for transformers.
This is a workshop checkpoint initialized from ncbi/Gene-R1-1B after replacing non-Latin tokenizer slots with HGNC protein-coding gene symbols and running FOCUS embedding initialization.
Downloads · 30 days
10
16% of all-time downloads
All-time downloads
62
Public
Parameters
1.2B
5 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors4.9 GB · 100%
From the Hugging Face model README
This is a workshop checkpoint initialized from ncbi/Gene-R1-1B after replacing
non-Latin tokenizer slots with HGNC protein-coding gene symbols and running
FOCUS embedding initialization.
ncbi/Gene-R1-1BThe output LM head was left unchanged because the downstream benchmark output is ordinary English biological process text; the modified inputs are gene symbols.
This checkpoint is intended for tokenizer-transfer workshop experiments before subsequent MATT transfer/fine-tuning. It is not a final benchmarked model.