Downloads · 30 days
50
4% of all-time downloads
Llama-3-Soliloquy-8B-i-GGUF
SolidSnacke/Llama-3-Soliloquy-8B-i-GGUF
Llama-3-Soliloquy-8B-i-GGUF is a text generation model from SolidSnacke. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-sa-4.0.
!!! A new version of the model has been released. I didn’t find any problems with word duplication, but I can’t promise anything. https://huggingface.co/SolidSnacke/Llama-3-Soliloquy-8B-v1.5-64k-i-GGUF
All-time downloads
1.4K
Public
Repo size
17.3 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf17.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-sa-4.0
- Access
- Public
- Created
- Apr 25, 2024
- Updated
- Apr 29, 2024
- SHA
- cef6bbb0
Try a prompt
Model card
From the Hugging Face model README
!!! A new version of the model has been released. I didn’t find any problems with word duplication, but I can’t promise anything. https://huggingface.co/SolidSnacke/Llama-3-Soliloquy-8B-v1.5-64k-i-GGUF
Edit: Currently this model has a problem with repeating words. That is, at some point you may experience duplication, like: passing by the table, he caught a red red red red red red... The problem most likely, as the author of the model explained, may be the wrong EOS token, but this is not certain. The author in another repository wrote that he will soon release a new model, so we are waiting.
I don't know what to write here.
Links to the original model and script:
- openlynn/Llama-3-Soliloquy-8B: https://huggingface.co/openlynn/Llama-3-Soliloquy-8B
- FantasiaFoundry/GGUF-Quantization-Script: https://huggingface.co/FantasiaFoundry/GGUF-Quantization-Script
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-sa-4.0
- Languages
- en
- Created
- Apr 25, 2024
- Updated
- Apr 29, 2024