Downloads · 30 days
1.4K
1% of all-time downloads
fbopt-350m-8bit
yec019/fbopt-350m-8bit
fbopt-350m-8bit is a text generation model from yec019. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as unknown.
This is a model for testing the effect of quantization. Part of the UCSD 23Fall 240D course project. The model is a pretrained model from facebook. Model name is opt-350m. We quantize it with 8 bit quantization provid…
All-time downloads
166K
Public
Parameters
331M
360 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors360 MB · 99%
Parameter types
How the weights are stored.
I8303M · 91%
Try a prompt
Model card
From the Hugging Face model README
This is a model for testing the effect of quantization. Part of the UCSD 23Fall 240D course project. The model is a pretrained model from facebook. Model name is opt-350m. We quantize it with 8 bit quantization provided by bitsandbytes. It is a quantization technique proposed in a paper.
- Task
- Text Generation
- Library
- transformers
- Type
- opt
- License
- unknown
- Created
- Nov 28, 2023
- Updated
- Nov 28, 2023