Mixtral_AI_Cyber_4.0

LeroyDyer/Mixtral_AI_Cyber_4.0

Mixtral_AI_Cyber_4.0 is a text generation model from LeroyDyer. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.

The following models were included in the merge: LeroyDyer/MixtralAICyber3.m1 LeroyDyer/MixtralAICyber3.1SFT LeroyDyer/MixtralAICyber2.0

Downloads · 30 days

1% of all-time downloads

All-time downloads

9.1K

Public

Parameters

7.2B

14.5 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors14.5 GB · 100%

At a glance

Task: Text Generation
Library: transformers
License: mit
Model type: mistral
Access: Public
Created: Mar 30, 2024
Updated: Jul 12, 2024
SHA: 7af1345b

Try a prompt

Base models

Model card

From the Hugging Face model README

Models Merged

The following models were included in the merge:

A Merges of my best models !:

A very great model as it contains the deltas from all of the very hard trained models : all these models were heavy coders!

Configuration

The following YAML configuration was used to produce this model:


models:
  - model: LeroyDyer/Mixtral_AI_Cyber_3.m2
    parameters:
      density: [0.256, 0.512, 0.128] # density gradient
      weight: 0.382
  - model: LeroyDyer/Mixtral_AI_Cyber_2.0
    parameters:
      density: 0.382
      weight: [0.256, 0.128, 0.256, 0.128] # weight gradient
  - model: LeroyDyer/Mixtral_AI_Cyber_3.0
    parameters:
      density: 0.382
      weight: [0.128, 0.512, 0.128, 0.128] # weight gradient      
  - model: LeroyDyer/Mixtral_AI_Cyber_3.m1
    parameters:
      density: 0.382
      weight: [0.256, 0.256, 0.512, 0.128] # weight gradient    
  - model: LeroyDyer/Mixtral_AI_Cyber_1.0
    parameters:
      density: 0.382
      weight: [0.128, 0.512, 0.128, 0.128] # weight gradient                
  - model: LeroyDyer/Mixtral_AI_Cyber_3.1_SFT
    parameters:
      density: 0.382
      weight:
        - filter: mlp
          value: 0.5
        - value: 0
merge_method: ties
base_model: LeroyDyer/Mixtral_AI_Cyber_3.m2
parameters:
  normalize: true
  int8_mask: true
dtype: float16

Task: Text Generation
Library: transformers
Type: mistral
License: mit
Languages: en
Created: Mar 30, 2024
Updated: Jul 12, 2024