Downloads · 30 days
18
2% of all-time downloads
k2_fp_delta
daven3/k2_fp_delta
k2_fp_delta is a text generation model from daven3. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
<div style="text-align:center" <img src="https://big-cheng.com/k2/k2.png" alt="k2-logo" width="200"/ <h2Delta Model for Large Language Model for Geoscience</h2 </div
All-time downloads
753
Public
Repo size
27 GB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.bin13.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jun 5, 2023
- Updated
- Jun 7, 2023
- SHA
- 23e9b240
Try a prompt
Datasets
Model card
From the Hugging Face model README
<div style="text-align:center">
<img src="https://big-cheng.com/k2/k2.png" alt="k2-logo" width="200"/>
<h2>Delta Model for Large Language Model for Geoscience</h2>
</div>
Introduction
We introduce K2 (7B), an open-source language model trained by firstly further pretraining LLaMA on collected and cleaned geoscience literature, including geoscience open-access papers and Wikipedia pages, and secondly fine-tuning with knowledge-intensive instruction tuning data (GeoSignal). As for preliminary evaluation, we use GeoBenchmark (consisting of NPEE and AP Test on Geology, Geography, and Environmental Science) as the benchmark. K2 outperforms the baselines on objective and subjective tasks compared to several baseline models with similar parameters. We release K2 delta weights after further pretraining with the geoscience text corpus to comply with the LLaMA model license.
The following is the overview of training K2:
How to Use
Please refer to K2 Github repo for further usage.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Jun 5, 2023
- Updated
- Jun 7, 2023