Downloads · 30 days
653
1% of all-time downloads
opt-125m-bnb-4bit
poedator/opt-125m-bnb-4bit
opt-125m-bnb-4bit is a text generation model from poedator. Use it when you need the model to write or continue text. It is set up for transformers.
facebook/OPT-125m quantized using bitsandbytes 4-bit NF4 quantization. All license matters are set based on the underlying facebook/OPT-125m model.
All-time downloads
130K
Public
Parameters
128M
374 MB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin125 MB · 49%
Parameter types
How the weights are stored.
U887.6M · 68%
Try a prompt
Model card
From the Hugging Face model README
facebook/OPT-125m quantized using bitsandbytes 4-bit NF4 quantization. All license matters are set based on the underlying facebook/OPT-125m model.
This model is work in progress, use it for testing https://github.com/huggingface/transformers/pull/26037 pull request only.
known issue: safetensors deleted linked "quant_map" / "nested_quant_map" items.
- Task
- Text Generation
- Library
- transformers
- Type
- opt
- Created
- Nov 8, 2023
- Updated
- Nov 10, 2023