Downloads · 30 days
7
2% of all-time downloads
Monero/oasst-alpaca13b-4epoch-4bit-128g
oasst-alpaca13b-4epoch-4bit-128g is a text generation model from Monero. Use it when you need the model to write or continue text. It is set up for transformers.
<p<strong<font size="5"Information</font</strong</p OpenAssistant-Alpaca-13B-4-bit working with GPTQ versions used in Oobabooga's Text Generation Webui and KoboldAI. <brThis was made using https://huggingface.co/chavi…
Downloads · 30 days
7
2% of all-time downloads
All-time downloads
393
Public
Repo size
7.5 GB
Likes
1
Public
Click a slice to open those files.
.safetensors7.5 GB · 100%
From the Hugging Face model README
python llama.py /Models/alpaca13b-oaast4ep-lora c4 --wbits 4 --true-sequential --groupsize 128 --save_safetensors oasst-alpaca13b-4ep-lora-4bit-128g.safetensors
<p><strong><font size="5">Benchmarks</font></strong></p>
<p><strong><font size="4">--true-sequential --groupsize 128</font></strong></p>
<strong>Wikitext2</strong>: 6.854333400726318
<strong>Ptb-New</strong>: 12.411578178405762
<strong>C4-New</strong>: 9.355494499206543
<strong>Note</strong>: This version uses <i>--groupsize 128</i>, resulting in better evaluations.