Downloads · 30 days
103
3% of all-time downloads
DareBeagel-2x7B-GGUF
StopTryharding/DareBeagel-2x7B-GGUF
DareBeagel-2x7B-GGUF is a machine learning model from StopTryharding. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
--- This is a repository of GGUF Quants for DareBeagel-2x7B ---
All-time downloads
3.9K
Public
Repo size
73.9 GB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.gguf73.9 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jan 28, 2024
- Updated
- Feb 4, 2024
- SHA
- 14552c84
Model card
From the Hugging Face model README
This is a repository of GGUF Quants for DareBeagel-2x7B
Original Model Available Here: https://huggingface.co/shadowml/DareBeagel-2x7B
Available Quants
- Q8_0
- Q6_K
- Q5_K_M
- Q5_K_S
- Q4_K_M
- Q4_K_S
- Q3_K_M
- Q3_K_S
- Q2_K
Beyonder-2x7B-v2
Beyonder-2x7B-v2 is a Mixure of Experts (MoE) made with the following models using LazyMergekit:
🧩 Configuration
base_model: mlabonne/NeuralBeagle14-7B
gate_mode: random
experts:
- source_model: mlabonne/NeuralBeagle14-7B
positive_prompts: [""]
- source_model: mlabonne/NeuralDaredevil-7B
positive_prompts: [""]
💻 Usage
Load in Kobold.cpp or whatever.
I found Alpaca (and Alpaca-ish) prompts worked well.
Settings that worked good for me are:
Min P - 0.1
Dynamic Temperature Min 0 Max 3
Rep Pen 1.03
Rep Pen Range 1000
- License
- apache-2.0
- Created
- Jan 28, 2024
- Updated
- Feb 4, 2024