Downloads · 30 days
138
2% of all-time downloads
scitulu-7b
allenai/scitulu-7b
scitulu-7b is a text generation model from allenai. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
SciTulu is a collection of instruction-following language models targeting scientific literature understanding use cases. Starting from the Tulu v2 7B model, SciTulu is trained on a mix of science-specific demonstrati…
All-time downloads
7K
Public
Repo size
27 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.bin13.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jun 12, 2024
- Updated
- Jun 13, 2024
- SHA
- 49fd11cf
Try a prompt
Model card
From the Hugging Face model README
Model Card for SciTulu 7B
SciTulu is a collection of instruction-following language models targeting scientific literature understanding use cases. Starting from the Tulu v2 7B model, SciTulu is trained on a mix of science-specific demonstrations from the SciRIFF dataset, together with general-domain instructions from the Tulu v2 SFT mix. SciTulu 7B achives a 28.1% average improvement over Tulu v2 7B on nine held-out scientific literature understanding tasks. More information can be found in our preprint: SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature.
Training and evaluation code for SciTulu is available in our GitHub repository: https://github.com/allenai/SciRIFF.
See the Tulu model card for more information on potential risks, biases, and limitations.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Jun 12, 2024
- Updated
- Jun 13, 2024