Downloads · 30 days
12
6% of all-time downloads
Nethena-MLewd-Xwin-23B-exl2
IHaBiS/Nethena-MLewd-Xwin-23B-exl2
Nethena-MLewd-Xwin-23B-exl2 is a text generation model from IHaBiS. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
main : 3.75bpw h8 b3.75h8 : 3.75bpw h8 b4h6 : 4bpw h6 b4h8 : 4bpw h8
All-time downloads
209
Public
Repo size
34.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors11.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- llama
- Access
- Public
- Created
- Oct 31, 2023
- Updated
- Oct 31, 2023
- SHA
- 99898446
Try a prompt
Model card
From the Hugging Face model README
Exl2 version of Undi95/Nethena-MLewd-Xwin-23B
branch
main : 3.75bpw h8
b3.75h8 : 3.75bpw h8
b4h6 : 4bpw h6
b4h8 : 4bpw h8
I checked that main branch runs on 24G GPU (tested on Runpod 3090 server)
Maybe I'll test 3.8bpw or 3.9bpw next time (Not sure about it)
below this line is original readme
Undi doing chemistry again.
Layer of Xwin-Mlewd was added in a different way than I do before, result seem good, but I'm a VRAMlet so I can only run the Q2 at 2k context for now.
Need to see if it really work good or I was just lucky with my prompt.
OG model : NeverSleep/Nethena-13B
Prompt template: Alpaca
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
LimaRP is always kicking in and thus, this can be used to have more control on the size of the output.
Thanks Ikari.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- cc-by-nc-4.0
- Created
- Oct 31, 2023
- Updated
- Oct 31, 2023