Downloads · 30 days
1
100% of all-time downloads
MKLLM-7B-Instruct-exl2
martinkozle/MKLLM-7B-Instruct-exl2
MKLLM-7B-Instruct-exl2 is a machine learning model from martinkozle. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-sa-4.0.
EXL2 quants of trajkovnikola/MKLLM-7B-Instruct
All-time downloads
1
Public
Repo size
18.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json1.8 MB · 100%
At a glance
- License
- cc-by-nc-sa-4.0
- Access
- Public
- Created
- Jun 26, 2024
- Updated
- Jun 27, 2024
- SHA
- 79fdfaa5
Model card
From the Hugging Face model README
MKLLM-7B-Instruct-exl2
EXL2 quants of trajkovnikola/MKLLM-7B-Instruct
<b>The "main" branch only contains the measurement.json (which can be used for further conversions), download one of the other branches for the model:</b>
6.5 bits per weight with 6 lm_head bits
5.0 bits per weight with 6 lm_head bits
4.25 bits per weight with 6 lm_head bits
3.5 bits per weight with 6 lm_head bits
Download instructions
With git:
git clone --single-branch --branch 5.0bpw-h6 https://huggingface.co/martinkozle/MKLLM-7B-Instruct-exl2 MKLLM-7B-Instruct-exl2-5.0bpw-h6
With huggingface hub:
To download a specific branch, use the --revision parameter.
huggingface-cli download martinkozle/MKLLM-7B-Instruct-exl2 --revision 5.0bpw-h6 --local-dir MKLLM-7B-Instruct-exl2-5.0bpw-h6 --local-dir-use-symlinks False
- License
- cc-by-nc-sa-4.0
- Languages
- mk, en
- Created
- Jun 26, 2024
- Updated
- Jun 27, 2024