Downloads · 30 days
14
5% of all-time downloads
CleverGirl-20b-Blended-v1.1-DARE
athirdpath/CleverGirl-20b-Blended-v1.1-DARE
CleverGirl-20b-Blended-v1.1-DARE is a text generation model from athirdpath. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
After I put down the joint and RTFM, I have a better idea exactly what's going on. I considered doing something similar with WANDA or SparseGPT a while back, but stopped when I ran into issues. Thus, I'm fascinated by…
All-time downloads
267
Public
Parameters
20B
40 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors40 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- llama
- Access
- Public
- Created
- Nov 30, 2023
- Updated
- Nov 30, 2023
- SHA
- 02a604c6
Try a prompt
Model card
From the Hugging Face model README
Description
After I put down the joint and RTFM, I have a better idea exactly what's going on. I considered doing something similar with WANDA or SparseGPT a while back, but stopped when I ran into issues. Thus, I'm fascinated by this new method's execution.
Hypothesis
By lowering the density, I hit closer to the sweet-spot shown in the paper. Also, I'm using my fixed base model, so hopefully that helps too. Weights are adjusted to make the later layers more aligned with ORCA 2.
Results
I'm quite happy with this model for what it is, a personable and effective assistant. It does infodump a bit, but what genius doesn't? It writes okay erotica and general fiction, it just has an "artifical" tone.
Recipe
merge_method: dare_ties
-
base_model: athirdpath/BigLlama-20b
-
model: athirdpath/CleverGirl-20b
weight: 0.60 / density: 0.35
-
model: athirdpath/CleverGirl-20b-Inverted
weight: 0.40 / density: 0.30
int8_mask: true
dtype: bfloat16
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- cc-by-nc-4.0
- Created
- Nov 30, 2023
- Updated
- Nov 30, 2023