Downloads · 30 days
8
24% of all-time downloads
mistral-7B-v0.1-4bit-mlx
Hinova/mistral-7B-v0.1-4bit-mlx
mistral-7B-v0.1-4bit-mlx is a machine learning model from Hinova. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
A 4-bit LoRA‑fine‑tuned Mistral-7B model in Apple MLX format, created via the MLX Examples LoRA tutorial.
All-time downloads
33
Public
Parameters
1.1B
4.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.1 GB · 100%
Parameter types
How the weights are stored.
U32905M · 80%
Base models
Model card
From the Hugging Face model README
Mistral-7B-v0.1-4bit-mlx
A 4-bit LoRA‑fine‑tuned Mistral-7B model in Apple MLX format, created via the MLX Examples LoRA tutorial.
🚀 Overview
This model was created by following the MLX LoRA tutorial:
- LoRA fine‑tuning applied on Mistral‑7B using low‑rank adapters
- Model fusion performed with
convert.pyto combine base weights and LoRA adapters - Quantized to 4-bit for memory efficiency on Apple Silicon devices
- Packaged in MLX format, ready for downstream use via
mlx-lm
The pipeline is fully automated based on mlx-examples/lora/convert.py, with no manual weight editing.
📦 Model Packaging
| File | Description |
|---|---|
weights.npz | Fused weights: base + LoRA adapters |
config.json | Model configuration & quantization metadata |
tokenizer.model | SentencePiece tokenizer for Mistral-7B |
💡 Usage
Inference with mlx-lm
pip install mlx-lm
- Type
- mistral
- Created
- Jul 7, 2025
- Updated
- Jul 7, 2025