Downloads · 30 days
34
0% of all-time downloads
genius-large-k2t
beyond/genius-large-k2t
genius-large-k2t is a machine learning model from beyond. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
- Paper: GENIUS: Sketch-based Language Model Pre-training via Extreme and Selective Masking for Text Generation and Augmentation
All-time downloads
54.8K
Public
Repo size
4.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.6 GB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- bart
- Access
- Public
- Created
- Nov 4, 2022
- Updated
- Dec 8, 2022
- SHA
- 50d9812b
Try a prompt
Datasets
Model card
From the Hugging Face model README
💡GENIUS – generating text using sketches!
💡GENIUS is a powerful conditional text generation model using sketches as input, which can fill in the missing contexts for a given sketch (key information consisting of textual spans, phrases, or words, concatenated by mask tokens). GENIUS is pre-trained on a large- scale textual corpus with a novel reconstruction from sketch objective using an extreme and selective masking strategy, enabling it to generate diverse and high-quality texts given sketches.
- Models hosted in 🤗 Huggingface:
Model variations:
| Model | #params | Language | comment |
|---|---|---|---|
genius-large | 406M | English | The version used in paper (recommend) |
genius-large-k2t | 406M | English | keywords-to-text |
genius-base | 139M | English | smaller version |
genius-base-ps | 139M | English | pre-trained both in paragraphs and short sentences |
genius-base-chinese | 116M | 中文 | 在一千万纯净中文段落上预训练 |
- Library
- transformers
- Type
- bart
- License
- apache-2.0
- Languages
- en
- Created
- Nov 4, 2022
- Updated
- Dec 8, 2022