Downloads · 30 days
9
8% of all-time downloads
Novaciano/NSFW-3.2-1B-openvino-4bit
NSFW-3.2-1B-openvino-4bit is a text generation model from Novaciano. Use it when you need the model to write or continue text. It is set up for transformers.
This model is a quantized version of Novaciano/NSFW-3.2-1B and is converted to the OpenVINO format. This model was obtained via the nncf-quantization space with optimum-intel.
Downloads · 30 days
9
8% of all-time downloads
All-time downloads
111
Public
Repo size
786 MB
Likes
0
Public
Click a slice to open those files.
.bin769 MB · 98%
From the Hugging Face model README
This model is a quantized version of Novaciano/NSFW-3.2-1B and is converted to the OpenVINO format. This model was obtained via the nncf-quantization space with optimum-intel.
First make sure you have optimum-intel installed:
pip install optimum[openvino]
To load your model you can do as follows:
from optimum.intel import OVModelForCausalLM
model_id = "Novaciano/NSFW-3.2-1B-openvino-4bit"
model = OVModelForCausalLM.from_pretrained(model_id)