Downloads · 30 days
45
9% of all-time downloads
tinyllama-proteinpretrain-quinoa
monsoon-nlp/tinyllama-proteinpretrain-quinoa
tinyllama-proteinpretrain-quinoa is a text generation model from monsoon-nlp. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Full model finetuning of TinyLLaMA-1.1B on the "research" split (quinoa protein sequences) of GreenBeing-Proteins dataset.
All-time downloads
527
Public
Parameters
1.1B
4.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Apr 3, 2024
- Updated
- Apr 21, 2024
- SHA
- abc79d9c
Try a prompt
Base models
Model card
From the Hugging Face model README
tinyllama-proteinpretrain-quinoa
Full model finetuning of TinyLLaMA-1.1B on the "research" split (quinoa protein sequences) of GreenBeing-Proteins dataset.
Notes: pretraining only on sequences leads the model to only generate protein sequences, eventually repeating VVVV ot KKKK.
- This model may be replaced with mixed training (bio/chem text and protein).
- This model might need "biotokens" to represent the amino acids instead of using the existing tokenizer.
More details TBD
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Apr 3, 2024
- Updated
- Apr 21, 2024