Downloads · 30 days
14
2% of all-time downloads
Monero/oasst-llama-13b-4-epochs-4bit-128g
oasst-llama-13b-4-epochs-4bit-128g is a text generation model from Monero. Use it when you need the model to write or continue text. It is set up for transformers.
<p<strong<font size="5"Information</font</strong</p OpenAssistant-Llama-13B-4-bit working with GPTQ versions used in Oobabooga's Text Generation Webui and KoboldAI. <brThis was made using <a href="https://huggingface.…
Downloads · 30 days
14
2% of all-time downloads
All-time downloads
577
Public
Repo size
7.5 GB
Likes
8
Public
Click a slice to open those files.
.safetensors7.5 GB · 100%
From the Hugging Face model README
python llama.py /KoboldAI/repos/gptq/llama13b-oasst-4-epochs-lora c4 --wbits 4 --true-sequential --groupsize 128 --save_safetensors llama13b-oasst-4-epochs-lora-4bit-128g.safetensors
<p><strong><font size="5">Benchmarks</font></strong></p>
<p><strong><font size="4">--true-sequential --groupsize 128</font></strong></p>
<strong>Wikitext2</strong>: 5.380471229553223
<strong>Ptb-New</strong>: 31.921072006225586
<strong>C4-New</strong>: 7.140256881713867
<strong>Note</strong>: This version uses <i>--groupsize 128</i>, resulting in better evaluations. However, it consumes more VRAM.