Synthia-13B-exl2

latimar/Synthia-13B-exl2

Synthia-13B-exl2 is a text generation model from latimar. Use it when you need the model to write or continue text. It is set up for transformers.

Weights of Synthia-13B converted to EXL2 format.

Downloads · 30 days

5% of all-time downloads

All-time downloads

240

Public

Repo size

17.8 GB

Likes

Public

Repo makeup

Click a slice to open those files.

.json1.8 MB · 78%

From the Hugging Face model README

Weights of Synthia-13B converted to EXL2 format.

Each separate quant is in a different branch, like in The Bloke's GPTQ repos.

export BRANCH=6_0-bpw-h6
git clone --single-branch --branch ${BRANCH} https://huggingface.co/latimar/Synthia-13B-exl2

There are the following branches:

4_625-bpw-h6
6_0-bpw-h6