Downloads · 30 days
11
34% of all-time downloads
Mistral-7B-codealpaca-lora-exl2
bartowski/Mistral-7B-codealpaca-lora-exl2
Mistral-7B-codealpaca-lora-exl2 is a machine learning model from bartowski. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Using <a href="https://github.com/turboderp/exllamav2/releases/tag/v0.0.6"turboderp's ExLlamaV2 v0.0.6</a for quantization.
All-time downloads
32
Public
Repo size
34.7 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.json3.3 MB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Oct 28, 2023
- Updated
- Oct 29, 2023
- SHA
- 346c5513
Model card
From the Hugging Face model README
Exllama v2 Quantization of Mistral-7B-codealpaca-lora
Using <a href="https://github.com/turboderp/exllamav2/releases/tag/v0.0.6">turboderp's ExLlamaV2 v0.0.6</a> for quantization.
Conversion done using evol-codealpaca-v1.parquet as calibration dataset.
Original model: https://huggingface.co/Nondzu/Mistral-7B-codealpaca-lora
<a href="https://huggingface.co/bartowski/Mistral-7B-codealpaca-lora-exl2/tree/6.0">6.0 bits per weight</a>
<a href="https://huggingface.co/bartowski/Mistral-7B-codealpaca-lora-exl2/tree/8.0">8.0 bits per weight</a>
<a href="https://huggingface.co/bartowski/Mistral-7B-codealpaca-lora-exl2/tree/4.0">4.0 bits per weight</a>
<a href="https://huggingface.co/bartowski/Mistral-7B-codealpaca-lora-exl2/tree/3.5">3.5 bits per weight</a>
- License
- apache-2.0
- Created
- Oct 28, 2023
- Updated
- Oct 29, 2023