Downloads · 30 days
427
14% of all-time downloads
duyntnet/Blurdus-7b-v0.1-imatrix-GGUF
Blurdus-7b-v0.1-imatrix-GGUF is a text generation model from duyntnet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Quantizations of https://huggingface.co/gate369/Blurdus-7b-v0.1
Downloads · 30 days
427
14% of all-time downloads
All-time downloads
2.9K
Public
Repo size
99.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf99.9 GB · 100%
From the Hugging Face model README
Quantizations of https://huggingface.co/gate369/Blurdus-7b-v0.1
Blurdus-7b-v0.1 is a merge of the following models using LazyMergekit:
models:
- model: 222gate/Blurred-Beagle-7b-slerp
parameters:
density: [1, 0.7, 0.1] # density gradient
weight: 1.0
- model: 222gate/BrurryDog-7b-v0.1
parameters:
density: 0.5
weight: [0, 0.3, 0.7, 1] # weight gradient
- model: liminerity/Blur-7b-v1.21
parameters:
density: 0.33
weight:
- filter: mlp
value: 0.5
- value: 0
merge_method: ties
base_model: udkai/Turdus
parameters:
normalize: true
int8_mask: true
dtype: float16
!pip install -qU transformers accelerate
from transformers import AutoTokenizer
import transformers
import torch
model = "222gate/Blurdus-7b-v0.1"
messages = [{"role": "user", "content": "What is a large language model?"}]
tokenizer = AutoTokenizer.from_pretrained(model)
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
pipeline = transformers.pipeline(
"text-generation",
model=model,
torch_dtype=torch.float16,
device_map="auto",
)
outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
print(outputs[0]["generated_text"])
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 74.35 |
| AI2 Reasoning Challenge (25-Shot) | 72.27 |
| HellaSwag (10-Shot) | 88.50 |
| MMLU (5-Shot) | 64.82 |
| TruthfulQA (0-shot) | 69.72 |
| Winogrande (5-shot) | 82.95 |
| GSM8k (5-shot) | 67.85 |