Downloads · 30 days
16
5% of all-time downloads
Imaginary-Embeddings-SpeakerTokens-STP
Justus-Jonas/Imaginary-Embeddings-SpeakerTokens-STP
Imaginary-Embeddings-SpeakerTokens-STP is a text generation model from Justus-Jonas. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-sa-4.0.
⚠️ This model is deprecated. Please don't use it as it produces embeddings of low quality. We recommend using triple-encoders instead, also if you want to use them as a classic bi-encoder.
All-time downloads
341
Public
Parameters
109M
876 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin438 MB · 50%
Parameter types
How the weights are stored.
F32109M · 100%
Try a prompt
Datasets
Model card
From the Hugging Face model README
⚠️ This model is deprecated. Please don't use it as it produces embeddings of low quality. We recommend using triple-encoders instead, also if you want to use them as a classic bi-encoder.
Imaginary Embeddings utilize Curved Contrastive Learning (see paper Imagination Is All You Need! (ACL 2023)) on Sentence Transformers for long-short term dialogue planning and efficient abstract sequence modeling.
This model uses speaker tokens and was evaluated in the Short-Term planning experiments.
Setup
python -m pip install imaginaryNLP
Usage
candidates = ['Want to eat something out ?',
'Want to go for a walk ?']
goal = ' I am hungry.'
stp.short_term_planning(candidates, goal)
- Task
- Text Generation
- Library
- transformers
- Type
- bert
- License
- cc-by-nc-sa-4.0
- Created
- Jul 9, 2023
- Updated
- Feb 22, 2024