Downloads · 30 days
0
dna_eng_bpe
dnagpt/dna_eng_bpe
dna_eng_bpe is a machine learning model from dnagpt. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
English and DNA sequence mixed BPE tokenizer
Access
Public
Updated Oct 12, 2024
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json3.1 MB · 85%
At a glance
- License
- mit
- Access
- Public
- Created
- Oct 12, 2024
- Updated
- Oct 12, 2024
- SHA
- 56b95da1
Model card
From the Hugging Face model README
brief
English and DNA sequence mixed BPE tokenizer
Basic use
from transformers import GPT2Tokenizer
tokenizer = GPT2Tokenizer.from_pretrained("dnagpt/dna_eng_bpe")
input = "Determine the following dna sequence is promoter or terminator TCTTTCTCTTCTGTATCATTCTACTTCTATGACTGCTCCTTCTCGAGTAAAACAGAATGTGTCTCAGGATTACTTTAAAACAAGACAAAGTATAGAGTTAAAATACATTTT"
token_list = tokenizer.tokenize(input)
print(" ".join(token_list))
#D eter mine Ġ the Ġ follow ing Ġ d na Ġ sequenc e Ġ is Ġ promo ter Ġ or Ġ termin ator Ġ Ġ TCTTTC TCTTC TGTATC ATTC TACTTC TATG ACTGC T...
github
- License
- mit
- Created
- Oct 12, 2024
- Updated
- Oct 12, 2024