Downloads · 30 days
95
63% of all-time downloads
zedfum/arman-longformer-8k
arman-longformer-8k is a summarization model from zedfum. Use it when you need a shorter version of a longer text. It is set up for transformers.
This project use Longformer's attention mechanism to alireza7/ARMAN-MSR-persian-base in order to perform abstractive summarization on long documents. so new model can accept 8K tokens (rather than 512 tokens).it shoul…
Downloads · 30 days
95
63% of all-time downloads
All-time downloads
152
Public
Repo size
2.4 GB
Likes
0
Public
Click a slice to open those files.
.bin1.2 GB · 99%
From the Hugging Face model README
This project use Longformer's attention mechanism to alireza7/ARMAN-MSR-persian-base in order to perform abstractive summarization on long documents. so new model can accept 8K tokens (rather than 512 tokens).it should be fine-tuned for summarization tasks.
converting code is available in github repository