Downloads · 30 days
128
4% of all-time downloads
scitulu-70b
allenai/scitulu-70b
scitulu-70b is a text generation model from allenai. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
SciTulu is a collection of instruction-following language models targeting scientific literature understanding use cases. Starting from the Tulu v2 70B model, SciTulu is trained on a mix of science-specific demonstrat…
All-time downloads
3.6K
Public
Repo size
276 GB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.bin138 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jun 12, 2024
- Updated
- Jun 13, 2024
- SHA
- c23a2fd2
Try a prompt
Model card
From the Hugging Face model README
Model Card for SciTulu 70B
SciTulu is a collection of instruction-following language models targeting scientific literature understanding use cases. Starting from the Tulu v2 70B model, SciTulu is trained on a mix of science-specific demonstrations from the SciRIFF dataset, together with general-domain instructions from the Tulu v2 SFT mix. SciTulu 70B achives a 6.5% average improvement over Tulu v2 70B on nine held-out scientific literature understanding tasks. More information can be found in our preprint: SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature.
Training and evaluation code for SciTulu is available in our GitHub repository: https://github.com/allenai/SciRIFF.
See the Tulu model card for more information on potential risks, biases, and limitations.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Jun 12, 2024
- Updated
- Jun 13, 2024