Downloads · 30 days
5
15% of all-time downloads
ministral_-_Ministral-3b-instruct-4bits
RichardErkhov/ministral_-_Ministral-3b-instruct-4bits
ministral_-_Ministral-3b-instruct-4bits is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
34
Public
Parameters
3.4B
2.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.2 GB · 100%
Parameter types
How the weights are stored.
U83.1B · 91%
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
Ministral-3b-instruct - bnb 4bits
- Model creator: https://huggingface.co/ministral/
- Original model: https://huggingface.co/ministral/Ministral-3b-instruct/
Original model description:
library_name: transformers inference: parameters: temperature: 1 top_p: 0.95 top_k: 40 repetition_penalty: 1.2 license: apache-2.0 language:
- en pipeline_tag: text-generation
Model Description
<!-- Provide a longer summary of what this model is. -->Ministral is a series of language model, build with same architecture as the famous Mistral model, but with less size.
- Model type: A 3B parameter GPT-like model fine-tuned on a mix of publicly available, synthetic datasets.
- Language(s) (NLP): Primarily English
- License: Apache 2.0
- Finetuned from model: mistralai/Mistral-7B-v0.1
- Type
- mistral
- Created
- Oct 24, 2024
- Updated
- Oct 24, 2024