Downloads · 30 days
39
3% of all-time downloads
InstructProtein
hicai-zju/InstructProtein
InstructProtein is a text generation model from hicai-zju. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
InstructProtein is the first large generative language model exploring the feasibility of bidirectional generation between human and protein language. It is based on OPT-1.3B architecture with two-step training approa…
All-time downloads
1.3K
Public
Parameters
1.3B
5.3 GB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors5.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- opt
- Access
- Public
- Created
- Jun 16, 2024
- Updated
- Jul 26, 2024
- SHA
- c5c43b2d
Try a prompt
Model card
From the Hugging Face model README
InstructProtein
InstructProtein is the first large generative language model exploring the feasibility of bidirectional generation between human and protein language. It is based on OPT-1.3B architecture with two-step training approach: It initiates with pre-training on protein and natural language corpora, followed by fine-tuning with the established protein knowledge instruction dataset. Through further instruction tuning, InstructProtein outperforms larger general-purpose foundation models on protein understanding and design tasks.
Limitations
The current model, developed through instruction tuning using knowledge instruction dataset, serves as a preliminary example. Despite its initial success in controlled environments, it lacks the robustness to manage complex, real-world, production-level tasks.
Reference
For more information, please take a look at our paper and repository.
- Task
- Text Generation
- Library
- transformers
- Type
- opt
- License
- mit
- Created
- Jun 16, 2024
- Updated
- Jul 26, 2024