Downloads · 30 days
22
15% of all-time downloads
YDXX/ViroHyena-436k
ViroHyena-436k is a text generation model from YDXX. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
ViroHyena is a Hyena-based nucleotide language model pre-trained on the ViroBlend corpus, a small (216 Mbp) mixed pretraining dataset with source-wise stratified sampling to balance human reference, multi-species geno…
Downloads · 30 days
22
15% of all-time downloads
All-time downloads
149
Public
Repo size
4.3 MB
Likes
2
Public
Click a slice to open those files.
.ckpt2.2 MB · 50%
From the Hugging Face model README
ViroHyena is a Hyena-based nucleotide language model pre-trained on the ViroBlend corpus, a small (216 Mbp) mixed pretraining dataset with source-wise stratified sampling to balance human reference, multi-species genomes, and viral in-domain sequences.
It was introduced in the paper ViroBench: Benchmarking Nucleotide Foundation Models on Viral Genomics Tasks.
Code: GitHub - ViroBench
| Model | Params | d_model | Layers |
|---|---|---|---|
| ViroHyena-436K | 0.436M | 128 | 2 |
| ViroHyena-1.6M | 1.6M | 256 | 2 |
| ViroHyena-6.6M | 6.6M | 256 | 8 |
| ViroHyena-253M | 253M | 1024 | 20 |
@article{ye2026virobench,
title={ViroBench: Benchmarking Nucleotide Foundation Models on Viral Genomics Tasks},
author={Ye, Dongxin and Hu, Fang and Hu, Han and Hu, Shu and Tan, Yang and Ouyang, Wanli and Li, Stan Z and Cui, Jie and Dong, Nanqing},
journal={arXiv preprint arXiv:2605.25388},
year={2026}
}