Downloads · 30 days
70
10% of all-time downloads
Stheno-L2-13B-i-GGUF
SolidSnacke/Stheno-L2-13B-i-GGUF
Stheno-L2-13B-i-GGUF is a text generation model from SolidSnacke. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
Want to make a couple models: ( • ̀ω•́ )✧
All-time downloads
697
Public
Repo size
22.3 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf22.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Access
- Public
- Created
- Apr 22, 2024
- Updated
- Apr 22, 2024
- SHA
- a7b3b62c
Try a prompt
Model card
From the Hugging Face model README
Want to make a couple models: ( • ̀ω•́ )✧
Downloading the original model, quantizing the GGUF-F16 model, creating imatrix.dat, quantizing the required models and then uploading them to the repository. In total, 4 and a half hours were spent: 💀
(It’s a pity I don’t have normal hardware for quantization)
Link to original model and script:
- Sao10K/Stheno-L2-13B: https://huggingface.co/Sao10K/Stheno-L2-13B
- FantasiaFoundry/GGUF-Quantization-Script: https://huggingface.co/FantasiaFoundry/GGUF-Quantization-Script
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Languages
- en
- Created
- Apr 22, 2024
- Updated
- Apr 22, 2024