Skip to content

joelniklaus

legal-xlm-longformer-base

joelniklaus/legal-xlm-longformer-base

legal-xlm-longformer-base is a fill-mask model from joelniklaus. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as cc.

This model is a multilingual model pretrained on legal data. It is based on XLM-R (base and large). For pretraining we used Multi Legal Pile (Niklaus et al. 2023), a multilingual dataset from various legal sources cov…

Downloads · 30 days

104

1% of all-time downloads

All-time downloads

7.1K

Public

Parameters

208M

13.3 GB on disk

Likes

5

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin834 MB · 50%

At a glance

Task
Fill-Mask
Library
transformers
License
cc
Model type
longformer
Access
Public
Created
May 10, 2023
Updated
Aug 6, 2023
SHA
0a363d2c
Task
Fill-Mask
Library
transformers
Type
longformer
License
cc
Languages
multilingual, bg, cs, da, de, el
Created
May 10, 2023
Updated
Aug 6, 2023