Downloads · 30 days
82
1% of all-time downloads
saishf_-_SOVLish-Devil-8B-L3-gguf
RichardErkhov/saishf_-_SOVLish-Devil-8B-L3-gguf
saishf_-_SOVLish-Devil-8B-L3-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
7.5K
Public
Repo size
92.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf108 GB · 100%
At a glance
- Access
- Public
- Created
- Oct 7, 2024
- Updated
- Oct 8, 2024
- SHA
- adfc3f58
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
SOVLish-Devil-8B-L3 - GGUF
- Model creator: https://huggingface.co/saishf/
- Original model: https://huggingface.co/saishf/SOVLish-Devil-8B-L3/
| Name | Quant method | Size |
|---|---|---|
| SOVLish-Devil-8B-L3.Q2_K.gguf | Q2_K | 2.96GB |
| SOVLish-Devil-8B-L3.IQ3_XS.gguf | IQ3_XS | 3.28GB |
| SOVLish-Devil-8B-L3.IQ3_S.gguf | IQ3_S | 3.43GB |
| SOVLish-Devil-8B-L3.Q3_K_S.gguf | Q3_K_S | 3.41GB |
| SOVLish-Devil-8B-L3.IQ3_M.gguf | IQ3_M | 3.52GB |
| SOVLish-Devil-8B-L3.Q3_K.gguf | Q3_K | 3.74GB |
| SOVLish-Devil-8B-L3.Q3_K_M.gguf | Q3_K_M | 3.74GB |
| SOVLish-Devil-8B-L3.Q3_K_L.gguf | Q3_K_L | 4.03GB |
| SOVLish-Devil-8B-L3.IQ4_XS.gguf | IQ4_XS | 4.18GB |
| SOVLish-Devil-8B-L3.Q4_0.gguf | Q4_0 | 4.34GB |
| SOVLish-Devil-8B-L3.IQ4_NL.gguf | IQ4_NL | 4.38GB |
| SOVLish-Devil-8B-L3.Q4_K_S.gguf | Q4_K_S | 4.37GB |
| SOVLish-Devil-8B-L3.Q4_K.gguf | Q4_K | 4.58GB |
| SOVLish-Devil-8B-L3.Q4_K_M.gguf | Q4_K_M | 4.58GB |
| SOVLish-Devil-8B-L3.Q4_1.gguf | Q4_1 | 4.78GB |
| SOVLish-Devil-8B-L3.Q5_0.gguf | Q5_0 | 5.21GB |
| SOVLish-Devil-8B-L3.Q5_K_S.gguf | Q5_K_S | 5.21GB |
| SOVLish-Devil-8B-L3.Q5_K.gguf | Q5_K | 5.34GB |
| SOVLish-Devil-8B-L3.Q5_K_M.gguf | Q5_K_M | 5.34GB |
| SOVLish-Devil-8B-L3.Q5_1.gguf | Q5_1 | 5.65GB |
| SOVLish-Devil-8B-L3.Q6_K.gguf | Q6_K | 6.14GB |
| SOVLish-Devil-8B-L3.Q8_0.gguf | Q8_0 | 7.95GB |
Original model description:
license: cc-by-nc-4.0 library_name: transformers tags:
- mergekit
- merge base_model:
- mlabonne/Daredevil-8B-abliterated
- ResplendentAI/RP_Format_QuoteAsterisk_Llama3
- mlabonne/Daredevil-8B-abliterated
- ResplendentAI/BlueMoon_Llama3
- mlabonne/Daredevil-8B-abliterated
- ResplendentAI/Luna_Llama3
- mlabonne/Daredevil-8B-abliterated
- mlabonne/Daredevil-8B-abliterated
- ResplendentAI/Aura_Llama3
- mlabonne/Daredevil-8B-abliterated
- ResplendentAI/Smarts_Llama3 model-index:
- name: SOVLish-Devil-8B-L3
results:
- task:
type: text-generation
name: Text Generation
dataset:
name: AI2 Reasoning Challenge (25-Shot)
type: ai2_arc
config: ARC-Challenge
split: test
args:
num_few_shot: 25
metrics:
- type: acc_norm value: 69.2 name: normalized accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=saishf/SOVLish-Devil-8B-L3 name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: HellaSwag (10-Shot)
type: hellaswag
split: validation
args:
num_few_shot: 10
metrics:
- type: acc_norm value: 84.44 name: normalized accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=saishf/SOVLish-Devil-8B-L3 name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: MMLU (5-Shot)
type: cais/mmlu
config: all
split: test
args:
num_few_shot: 5
metrics:
- type: acc value: 68.97 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=saishf/SOVLish-Devil-8B-L3 name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: TruthfulQA (0-shot)
type: truthful_qa
config: multiple_choice
split: validation
args:
num_few_shot: 0
metrics:
- type: mc2 value: 57.95 source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=saishf/SOVLish-Devil-8B-L3 name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: Winogrande (5-shot)
type: winogrande
config: winogrande_xl
split: validation
args:
num_few_shot: 5
metrics:
- type: acc value: 78.14 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=saishf/SOVLish-Devil-8B-L3 name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: GSM8k (5-shot)
type: gsm8k
config: main
split: test
args:
num_few_shot: 5
metrics:
- type: acc value: 72.48 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=saishf/SOVLish-Devil-8B-L3 name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: AI2 Reasoning Challenge (25-Shot)
type: ai2_arc
config: ARC-Challenge
split: test
args:
num_few_shot: 25
metrics:
merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
Devil >:3
This is another "SOVL" style merge, this time using mlabonne/Daredevil-8B-abliterated.
Daredevil is the first abliterated model i've tried that feels as smart as base llama-3-instruct while also being willing to give instructions to do all kinda of illegal things
This model should do well in rp, I'm yet to test it (waiting for gguf files @_@)
Merge Method
This model was merged using the Model Stock merge method using mlabonne/Daredevil-8B-abliterated as a base.
Models Merged
The following models were included in the merge:
- mlabonne/Daredevil-8B-abliterated + ResplendentAI/RP_Format_QuoteAsterisk_Llama3
- mlabonne/Daredevil-8B-abliterated + ResplendentAI/BlueMoon_Llama3
- mlabonne/Daredevil-8B-abliterated + ResplendentAI/Luna_Llama3
- mlabonne/Daredevil-8B-abliterated + ResplendentAI/Aura_Llama3
- mlabonne/Daredevil-8B-abliterated + ResplendentAI/Smarts_Llama3
Configuration
The following YAML configuration was used to produce this model:
models:
- model: mlabonne/Daredevil-8B-abliterated+ResplendentAI/Aura_Llama3
- model: mlabonne/Daredevil-8B-abliterated+ResplendentAI/Smarts_Llama3
- model: mlabonne/Daredevil-8B-abliterated+ResplendentAI/Luna_Llama3
- model: mlabonne/Daredevil-8B-abliterated+ResplendentAI/BlueMoon_Llama3
- model: mlabonne/Daredevil-8B-abliterated+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
merge_method: model_stock
base_model: mlabonne/Daredevil-8B-abliterated
dtype: bfloat16
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 71.86 |
| AI2 Reasoning Challenge (25-Shot) | 69.20 |
| HellaSwag (10-Shot) | 84.44 |
| MMLU (5-Shot) | 68.97 |
| TruthfulQA (0-shot) | 57.95 |
| Winogrande (5-shot) | 78.14 |
| GSM8k (5-shot) | 72.48 |
- Created
- Oct 7, 2024
- Updated
- Oct 8, 2024