Downloads · 30 days
111
3% of all-time downloads
OPT-13B-Erebus-4bit-128g
notstoic/OPT-13B-Erebus-4bit-128g
OPT-13B-Erebus-4bit-128g is a text generation model from notstoic. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.
All-time downloads
3.6K
Public
Repo size
15.1 GB
Likes
17
Public
Repo makeup
Click a slice to open those files.
.safetensors7.8 GB · 52%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- opt
- Access
- Public
- Created
- Apr 7, 2023
- Updated
- May 13, 2023
- SHA
- d8496aa8
Try a prompt
Model card
From the Hugging Face model README
OPT-13B-Erebus-4bit-128g
Model description
Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.
This is a 4-bit GPTQ quantization of OPT-13B-Erebus, original model: https://huggingface.co/KoboldAI/OPT-13B-Erebus
Quantization Information
Quantized with: https://github.com/0cc4m/GPTQ-for-LLaMa
python repos/gptq/opt.py --wbits 4 models/KoboldAI_OPT-13B-Erebus c4 --groupsize 128 --save models/KoboldAI_OPT-13B-Erebus/OPT-13B-Erebus-4bit-128g.pt
python repos/gptq/opt.py --wbits 4 models/KoboldAI_OPT-13B-Erebus c4 --groupsize 128 --save_safetensors models/KoboldAI_OPT-13B-Erebus/OPT-13B-Erebus-4bit-128g.safetensors
License
OPT-13B is licensed under the OPT-175B license, Copyright (c) Meta Platforms, Inc. All Rights Reserved.
- Task
- Text Generation
- Library
- transformers
- Type
- opt
- License
- other
- Languages
- en
- Created
- Apr 7, 2023
- Updated
- May 13, 2023