Downloads · 30 days
17
3% of all-time downloads
MeetPEFT-7B-16K
MeetPEFT/MeetPEFT-7B-16K
MeetPEFT-7B-16K is a summarization model from MeetPEFT. Use it when you need a shorter version of a longer text. It is set up for transformers.
We use quantized LongLoRA to fine-tune a Llama-2-7b model and extend the context length from 4k to 16k.
All-time downloads
604
Public
Repo size
40.4 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin13.5 GB · 100%
At a glance
- Task
- Summarization
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Dec 4, 2023
- Updated
- Dec 5, 2023
- SHA
- aced8055
Try a prompt
Model card
From the Hugging Face model README
MeetPEFT: Parameter Efficient Fine-Tuning on LLMs for Long Meeting Summarization
We use quantized LongLoRA to fine-tune a Llama-2-7b model and extend the context length from 4k to 16k.
The model is fine-tuned on MeetingBank and QMSum datasets.
- Task
- Summarization
- Library
- transformers
- Type
- llama
- Languages
- en
- Created
- Dec 4, 2023
- Updated
- Dec 5, 2023