Downloads · 30 days
3
1% of all-time downloads
sandwichdoge/Nous-Capybara-limarpv3-34B-4.65bpw-hb6-exl2
Nous-Capybara-limarpv3-34B-4.65bpw-hb6-exl2 is a text generation model from sandwichdoge. Use it when you need the model to write or continue text. It is set up for transformers.
Original model: https://huggingface.co/Doctor-Shotgun/Nous-Capybara-limarpv3-34B
Downloads · 30 days
3
1% of all-time downloads
All-time downloads
354
Public
Repo size
41.5 GB
Likes
0
Public
Click a slice to open those files.
.safetensors20.8 GB · 100%
From the Hugging Face model README
Original model: https://huggingface.co/Doctor-Shotgun/Nous-Capybara-limarpv3-34B
Using erotiquantxl.parquet as calibration dataset.
4.65bpw - Can run 21k context in ~23.3GB VRAM with 8bit-cache option.
Prompt format - extended alpaca with length modifier:
Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
### Instruction:
{instruction}
### Input:
{input}
### Response: (length = long)