Downloads · 30 days
13
3% of all-time downloads
longformer-8192
capemox/longformer-8192
longformer-8192 is a feature extraction model from capemox. Use it when you need embeddings to search or compare text. It is set up for transformers.
Longformer model with 8192 tokens sequence length. Initialized from FaceboookAI/roberta-base. No additional pre-training has been done.
All-time downloads
499
Public
Parameters
152M
607 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors607 MB · 99%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- longformer
- Access
- Public
- Created
- Oct 3, 2024
- Updated
- Oct 6, 2024
- SHA
- 74a39e84
Base models
Model card
From the Hugging Face model README
Longformer 8192
<!-- Provide a quick summary of what the model is/does. -->Longformer model with 8192 tokens sequence length. Initialized from FaceboookAI/roberta-base. No additional pre-training has been done.
Model can be loaded and run using AutoModel and AutoTokenizer.
- Task
- Feature Extraction
- Library
- transformers
- Type
- longformer
- Created
- Oct 3, 2024
- Updated
- Oct 6, 2024