Downloads · 30 days
6
17% of all-time downloads
NemoMix-Unleashed-12B-int4-ov
FqU/NemoMix-Unleashed-12B-int4-ov
NemoMix-Unleashed-12B-int4-ov is a text generation model from FqU. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
INT4-квантованная версия MarinaraSpaghetti/NemoMix-Unleashed-12B в формате OpenVINO IR.
All-time downloads
35
Public
Repo size
7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin7 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Sep 8, 2026
- Updated
- Sep 8, 2026
- SHA
- ddc54cf6
Try a prompt
Base models
Model card
From the Hugging Face model README
NemoMix-Unleashed-12B — OpenVINO INT4
INT4-квантованная версия MarinaraSpaghetti/NemoMix-Unleashed-12B в формате OpenVINO IR.
Оригинальная модель — merge через mergekit (della_linear) на базе Mistral-Nemo, лицензия apache-2.0.
Конвертация
Квантовано в INT4 через optimum-intel / OpenVINO NNCF.
Использование
from optimum.intel import OVModelForCausalLM
from transformers import AutoTokenizer
model = OVModelForCausalLM.from_pretrained("ваш-username/NemoMix-Unleashed-12B-int4-ov")
tokenizer = AutoTokenizer.from_pretrained("ваш-username/NemoMix-Unleashed-12B-int4-ov")
- Task
- Text Generation
- Type
- mistral
- License
- apache-2.0
- Languages
- en
- Created
- Sep 8, 2026
- Updated
- Sep 8, 2026