Downloads · 30 days
18
27% of all-time downloads
CATA-8x7B
Envoid/CATA-8x7B
CATA-8x7B is a text generation model from Envoid. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
This model may output adult content and can sometimes be a little bit unpredictable.
All-time downloads
66
Public
Parameters
46.7B
93.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors93.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- mixtral
- Access
- Public
- Created
- Jan 12, 2024
- Updated
- Jan 12, 2024
- SHA
- af70cb63
Try a prompt
Model card
From the Hugging Face model README
Caution:
This model may output adult content and can sometimes be a little bit unpredictable.
CATA
or Cerebrovascular Anthology (Task Arithmetic) utilizes Charles Goddard's mergekit
Using the Task Arithmetic method I combined
I utilized the following config:
base_model: ./mistralai_Mixtral-8x7B-Instruct-v0.1
models:
- model: ./Augmentasanguis-8x7B
parameters:
weight: 0.4
- model: ./Augmentasanguis-PDE-8x7B
parameters:
weight: 0.3
- model: ./Dendrite-8x7Bv1
parameters:
weight: 0.3
merge_method: task_arithmetic
dtype: float16
The model has inherited the strengths of all 3 models without any of the drawbacks. Making it an excellent choice for role play and creative writing.
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- cc-by-nc-4.0
- Created
- Jan 12, 2024
- Updated
- Jan 12, 2024