Downloads · 30 days
21
1% of all-time downloads
InfinityKuno-2x7B-GGUF
R136a1/InfinityKuno-2x7B-GGUF
InfinityKuno-2x7B-GGUF is a machine learning model from R136a1. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
All-time downloads
2.2K
Public
Repo size
40.2 GB
Likes
8
Public
Repo makeup
Click a slice to open those files.
.gguf40.2 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Mar 17, 2024
- Updated
- Mar 17, 2024
- SHA
- 421447b9
Model card
From the Hugging Face model README
InfinityKuno-2x7B
GGUF-Imatrix quantizations of InfinityKuno-2x7B
Experimental model from Endevor/InfinityRP-v1-7B and SanjiWatsuki/Kunoichi-DPO-v2-7B models. Merged to MoE model with 2x7B parameters.
Perplexity
Using llama.cpp/perplexity with private roleplay dataset.
| Format | PPL |
|---|---|
| FP16 | 3.2686 +/- 0.12496 |
| Q8_0 | 3.2738 +/- 0.12570 |
| Q5_K_M | 3.2589 +/- 0.12430 |
| IQ4_NL | 3.2689 +/- 0.12487 |
| IQ3_M | 3.3097 +/- 0.12233 |
| IQ2_M | 3.4658 +/- 0.13077 |
Prompt format:
Alpaca, Extended Alpaca, Roleplay-Alpaca. (Use any Alpaca based prompt formatting and you should be fine.)
- License
- apache-2.0
- Languages
- en
- Created
- Mar 17, 2024
- Updated
- Mar 17, 2024