Downloads · 30 days
20
15% of all-time downloads
YDXX/ViroHyena-6m
ViroHyena-6m is a text generation model from YDXX. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
ViroHyena is a Hyena-based nucleotide language model introduced in the paper ViroBench: Benchmarking Nucleotide Foundation Models on Viral Genomics Tasks.
Downloads · 30 days
20
15% of all-time downloads
All-time downloads
134
Public
Repo size
55.7 MB
Likes
2
Public
Click a slice to open those files.
.ckpt27.9 MB · 50%
From the Hugging Face model README
ViroHyena is a Hyena-based nucleotide language model introduced in the paper ViroBench: Benchmarking Nucleotide Foundation Models on Viral Genomics Tasks.
This specific checkpoint is the 6.6M parameter version. It was pre-trained on the ViroBlend corpus, a 216 Mbp mixed pretraining dataset using source-wise stratified sampling to balance human reference, multi-species genomes, and viral in-domain sequences.
| Model | Params | d_model | Layers |
|---|---|---|---|
| ViroHyena-436K | 0.436M | 128 | 2 |
| ViroHyena-1.6M | 1.6M | 256 | 2 |
| ViroHyena-6.6M | 6.6M | 256 | 8 |
| ViroHyena-253M | 253M | 1024 | 20 |
This model was developed for biological understanding and measurement research. As noted in the project documentation:
@article{ye2026virobench,
title={ViroBench: Benchmarking Nucleotide Foundation Models on Viral Genomics Tasks},
author={Ye, Dongxin and Hu, Fang and Hu, Han and Hu, Shu and Tan, Yang and Ouyang, Wanli and Li, Stan Z and Cui, Jie and Dong, Nanqing},
journal={arXiv preprint arXiv:2605.25388},
year={2026}
}