Downloads · 30 days
12
5% of all-time downloads
mistral-small-instruct-2409-ov
llmware/mistral-small-instruct-2409-ov
mistral-small-instruct-2409-ov is a machine learning model from llmware. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
mistral-small-instruct-2409-ov is an OpenVino int4 quantized version of mistral-small-instruct-2409, which is a research 22B general purpose chat/instruct model from Mistral.
All-time downloads
224
Public
Repo size
11.8 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin11.8 GB · 100%
At a glance
- License
- other
- Model type
- mistral
- Access
- Public
- Created
- Oct 10, 2024
- Updated
- Oct 31, 2024
- SHA
- 4d0243e8
Base models
Model card
From the Hugging Face model README
mistral-small-instruct-2409-ov
mistral-small-instruct-2409-ov is an OpenVino int4 quantized version of mistral-small-instruct-2409, which is a research 22B general purpose chat/instruct model from Mistral.
This model is licensed under MRL (Mistral Research License), which can be found here. Per this license, this model is available only for research.
We are including in this collection for the purpose of testing the speed and quality of a 4-bit OpenVino quantized 22B parameter model running locally on an AI PC.
Model Description
- Developed by: mistralai
- Quantized by: llmware
- Model type: mistral-small-instruct-2409-ov
- Parameters: 22 billion
- Model Parent: mistralai/mistral-small-instruct-2409
- Language(s) (NLP): English
- License: MRL - research only - not commercial
- Uses: General use
- Quantization: int4
Model Card Contact
- Type
- mistral
- License
- other
- Created
- Oct 10, 2024
- Updated
- Oct 31, 2024