Downloads · 30 days
42
4% of all-time downloads
MythoMax-L2-13B-exl2
R136a1/MythoMax-L2-13B-exl2
MythoMax-L2-13B-exl2 is a text generation model from R136a1. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
EXL2 Quantization of Gryphe's MythoMax L2 13B.
All-time downloads
1.1K
Public
Repo size
63.5 GB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.safetensors9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Sep 21, 2023
- Updated
- Sep 28, 2023
- SHA
- 363d6264
Try a prompt
Model card
From the Hugging Face model README
EXL2 Quantization of Gryphe's MythoMax L2 13B.
Other quantized models are available from TheBloke: GGML - GPTQ - GGUF - AWQ
Model details
Base Perplexity : 5.7447
| Branch | bits | Perplexity | Description |
|---|---|---|---|
| 3bit | 3.73 | 5.8251 | Low bits quant while still good |
| 4bit | 4.33 | 5.7784 | can go 6K context on T4 GPU |
| main | 5.33 | 5.7427 | 4k Context on T4 GPU (recommended if you use Google Colab) |
| 6bit | 6.13 | 5.7347 | For those who want better quality and capable of running it |
Prompt Format
Alpaca format:
### Instruction:
### Response:
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Languages
- en
- Created
- Sep 21, 2023
- Updated
- Sep 28, 2023