Downloads · 30 days
14
22% of all-time downloads
SthenoWriter-L2-13B-GPTQ
harmtech/SthenoWriter-L2-13B-GPTQ
SthenoWriter-L2-13B-GPTQ is a text generation model from harmtech. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
4-bit GPTQ quants of the writer version of Sao10K's fantastic SthenoWriter model (Stheno model collection link)
All-time downloads
63
Public
Parameters
2B
30 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors7.3 GB · 100%
Parameter types
How the weights are stored.
I321.6B · 79%
Try a prompt
Model card
From the Hugging Face model README
Daddy Dave's stamp of approval 👍
4-bit GPTQ quants of the writer version of Sao10K's fantastic SthenoWriter model (Stheno model collection link)
The main branch contains 4-bit groupsize of 128 and no act_order.
The other branches contain groupsizes of 128, 64, and 32 all with act_order.
⬇︎ Original card ⬇︎
<img src="https://c4.wallpaperflare.com/wallpaper/309/535/658/anime-anime-girls-fate-series-fate-grand-order-stheno-fate-grand-order-hd-wallpaper-preview.jpg" style="width: 70%; min-width: 300px; display: block; margin: auto;">A Stheno-1.8 Variant focused on writing.
Stheno-1.8 + Storywriter, mixed with Holodeck + Spring Dragon qLoRA. End Result is mixed with One More Experimental Literature-based LoRA.
Re-Reviewed... it's not bad, honestly.
Support me here :)
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 48.35 |
| ARC (25-shot) | 62.29 |
| HellaSwag (10-shot) | 83.28 |
| MMLU (5-shot) | 56.14 |
| TruthfulQA (0-shot) | 44.72 |
| Winogrande (5-shot) | 74.35 |
| GSM8K (5-shot) | 11.22 |
| DROP (3-shot) | 6.48 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Languages
- en
- Created
- Dec 23, 2023
- Updated
- Dec 23, 2023