Downloads · 30 days
0
0% of all-time downloads
CalliopeDS-v2-L2-13B-exl2
DS-Archive/CalliopeDS-v2-L2-13B-exl2
CalliopeDS-v2-L2-13B-exl2 is a text generation model from DS-Archive. Use it when you need the model to write or continue text. The card lists the license as llama2.
Exllama v2 quant of Doctor-Shotgun/CalliopeDS-v2-L2-13B
All-time downloads
15
Public
Repo size
30.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json4.4 MB · 100%
At a glance
- Task
- Text Generation
- License
- llama2
- Access
- Public
- Created
- Sep 28, 2023
- Updated
- Oct 1, 2023
- SHA
- fe1f3c8c
Try a prompt
Model card
From the Hugging Face model README
CalliopeDS-v2-L2-13B-exl2
Exllama v2 quant of Doctor-Shotgun/CalliopeDS-v2-L2-13B
Branches:
- main: measurement.json calculated at 2048 token calibration rows on PIPPA
- 4.0bpw-h6: 4 decoder bits per weight, 6 head bits
- ideal for 12gb GPUs, or 16gb GPUs with NTK extended context or CFG
- 6.0bpw-h6: 6 decoder bits per weight, 6 head bits
- ideal for 16gb GPUs, or 24gb GPUs with NTK extended context or CFG
- 8bit-32g-h8: all tensors 8bit 32g, 8 head bits
- experimental quant, this is with exllamav2 monkeypatched to quantize all tensors to 8bit 32g
- similar in size to old GPTQ 8bit no groupsize, recommend 24gb GPU
- Task
- Text Generation
- License
- llama2
- Languages
- en
- Created
- Sep 28, 2023
- Updated
- Oct 1, 2023