Downloads · 30 days
115
1% of all-time downloads
Mistral-Large-Instruct-2407-bnb-4bit
unsloth/Mistral-Large-Instruct-2407-bnb-4bit
Mistral-Large-Instruct-2407-bnb-4bit is a text generation model from unsloth. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
We have a free Google Colab Tesla T4 notebook for Mistral Nemo 12b (8B) here: https://colab.research.google.com/drive/17d3U-CAIwzmbDRqbZ9NnpHxCkmXB6LZ0?usp=sharing
All-time downloads
9.1K
Public
Parameters
126B
64.5 GB on disk
Likes
12
Public
Repo makeup
Click a slice to open those files.
.safetensors64.5 GB · 100%
Parameter types
How the weights are stored.
U8126B · 99%
Try a prompt
Model card
From the Hugging Face model README
Finetune Llama 3.1, Gemma 2, Mistral 2-5x faster with 70% less memory via Unsloth!
We have a free Google Colab Tesla T4 notebook for Mistral Nemo 12b (8B) here: https://colab.research.google.com/drive/17d3U-CAIwzmbDRqbZ9NnpHxCkmXB6LZ0?usp=sharing
<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/Discord%20button.png" width="200"/> <img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>
✨ Finetune for Free
All notebooks are beginner friendly! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model which can be exported to GGUF, vLLM or uploaded to Hugging Face.
| Unsloth supports | Free Notebooks | Performance | Memory use |
|---|---|---|---|
| Llama-3 8b | ▶️ Start on Colab | 2.4x faster | 58% less |
| Gemma 7b | ▶️ Start on Colab | 2.4x faster | 58% less |
| Mistral 7b | ▶️ Start on Colab | 2.2x faster | 62% less |
| Llama-2 7b | ▶️ Start on Colab | 2.2x faster | 43% less |
| TinyLlama | ▶️ Start on Colab | 3.9x faster | 74% less |
| CodeLlama 34b A100 | ▶️ Start on Colab | 1.9x faster | 27% less |
| Mistral 7b 1xT4 | ▶️ Start on Kaggle | 5x faster* | 62% less |
| DPO - Zephyr | ▶️ Start on Colab | 1.9x faster | 19% less |
- This conversational notebook is useful for ShareGPT ChatML / Vicuna templates.
- This text completion notebook is for raw text. This DPO notebook replicates Zephyr.
- * Kaggle has 2x T4s, but we use 1. Due to overhead, 1x T4 is 5x faster.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- other
- Languages
- en
- Created
- Jul 24, 2024
- Updated
- Sep 11, 2024