Downloads · 30 days
85
0% of all-time downloads
OPT-13B-Nerybus-Mix-4bit-128g
notstoic/OPT-13B-Nerybus-Mix-4bit-128g
OPT-13B-Nerybus-Mix-4bit-128g is a text generation model from notstoic. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.
All-time downloads
27.8K
Public
Repo size
15.1 GB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.safetensors7.8 GB · 52%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- opt
- Access
- Public
- Created
- Apr 7, 2023
- Updated
- Apr 7, 2023
- SHA
- 86799b21
Try a prompt
Model card
From the Hugging Face model README
OPT-13B-Nerybus-Mix-4bit-128g
Model description
Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.
This is a 4-bit GPTQ quantization of OPT-13B-Nerybus-Mix, original model: https://huggingface.co/KoboldAI/OPT-13B-Nerybus-Mix
Quantization Information
Quantized with: https://github.com/0cc4m/GPTQ-for-LLaMa
python repos/gptq/opt.py --wbits 4 models/KoboldAI_OPT-13B-Nerybus-Mix c4 --groupsize 128 --save models/KoboldAI_OPT-13B-Nerybus-Mix/OPT-13B-Nerybus-Mix-4bit-128g.pt
python repos/gptq/opt.py --wbits 4 models/KoboldAI_OPT-13B-Nerybus-Mix c4 --groupsize 128 --save_safetensors models/KoboldAI_OPT-13B-Nerybus-Mix/OPT-13B-Nerybus-Mix-4bit-128g.safetensors
License
OPT-13B is licensed under the OPT-175B license, Copyright (c) Meta Platforms, Inc. All Rights Reserved.
- Task
- Text Generation
- Library
- transformers
- Type
- opt
- License
- other
- Languages
- en
- Created
- Apr 7, 2023
- Updated
- Apr 7, 2023