Downloads · 30 days
385
0% of all-time downloads
migtissera/Tess-XS-v1-3-yarn-128K
Tess-XS-v1-3-yarn-128K is a text generation model from migtissera. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This version is the stable release. The issues that were present in versions 1.0, 1.1 and 1.2 all have been rectified. Thank you for your patience while R&D was conducted. Enjoy!
Downloads · 30 days
385
0% of all-time downloads
All-time downloads
124K
Public
Repo size
29 GB
Likes
13
Public
Click a slice to open those files.
.bin14.5 GB · 100%
From the Hugging Face model README
This version is the stable release. The issues that were present in versions 1.0, 1.1 and 1.2 all have been rectified. Thank you for your patience while R&D was conducted. Enjoy!
This model have been tested on context length up to 16K. Model produced slight repetition around 16K context length. I recommend testing the model to your usecase and limiting the context length.
Here's my learnings going from Tess-v1.0 to Tess-v1.3: https://migel.substack.com/p/learnings-from-training-tess

Tess, short for Tesoro (Treasure in Italian), is a general purpose Large Language Model series. Tess-XS-v1.3 was trained on the Nous Research Mistral-7B-yarn-128K base.
SYSTEM: <ANY SYSTEM CONTEXT>
USER:
ASSISTANT: