Downloads · 30 days
31
0% of all-time downloads
Kyllene-57B-v1.0
TeeZee/Kyllene-57B-v1.0
Kyllene-57B-v1.0 is a text generation model from TeeZee. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
All-time downloads
8.8K
Public
Parameters
56.7B
113 GB on disk
Likes
7
Public
Repo makeup
Click a slice to open those files.
.safetensors113 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Jan 16, 2024
- Updated
- Mar 4, 2024
- SHA
- d06910c2
Try a prompt
Model card
From the Hugging Face model README
Kyllene 57B v1.0
Model Details
- A result of using SLERP merge of TeeZee/2xbagel-dpo-34b-v0.2 and TeeZee/2xNous-Capybara-34B.
- The resulting model has 100 layers and approximately 57 billion parameters.
- 200K context length
- See mergekit-config.yml for details on the merge method used.
Warning: This model can produce NSFW content!
Results
- produces SFW nad NSFW content without issues, switches context seamlessly.
- good at following instructions
- pretty close to my ideal RPG/ERP everyday model (but more tests are needed)
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel: <a href="https://www.buymeacoffee.com/TeeZee" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 64.86 |
| AI2 Reasoning Challenge (25-Shot) | 64.85 |
| HellaSwag (10-Shot) | 84.51 |
| MMLU (5-Shot) | 73.33 |
| TruthfulQA (0-shot) | 57.89 |
| Winogrande (5-shot) | 78.22 |
| GSM8k (5-shot) | 30.40 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Created
- Jan 16, 2024
- Updated
- Mar 4, 2024