ThinkExtension-4x7

LoSboccacc/ThinkExtension-4x7

ThinkExtension-4x7 is a machine learning model from LoSboccacc. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

Downloads · 30 days

2% of all-time downloads

All-time downloads

656

Public

Repo size

93.8 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf93.8 GB · 100%

At a glance

License: apache-2.0
Access: Public
Created: Jan 14, 2024
Updated: Jan 14, 2024
SHA: 2014be17

Model card

From the Hugging Face model README

MOE with Mergekit/Mixtral:

    base_model: mistralai/Mistral-7B-Instruct-v0.2
    gate_mode: hidden # one of "hidden", "cheap_embed", or "random"
    dtype: bfloat16 # output dtype (float32, float16, or bfloat16)
    experts:
      - source_model: SanjiWatsuki/Silicon-Maid-7B
        positive_prompts:
          - "roleplay"
          - "story telling"
          - "fantasy"
          - "dreaming"
      - source_model: teknium/OpenHermes-2.5-Mistral-7B
        positive_prompts:
          - "chat"
          - "flow chart"
          - "diagrams"
          - "reasoning"
          - "explanation"
      - source_model: Nondzu/Mistral-7B-Instruct-v0.2-code-ft
        positive_prompts:
          - "programming"
          - "code debugging"
          - "data transformation"
          - "data structures"
        negative_prompt:
          - "chat"
      - source_model: meta-math/MetaMath-Mistral-7B
        positive_prompts:
          - "math"
          - "arithmetic"
          - "algebra"

chatml prompt

License: apache-2.0
Created: Jan 14, 2024
Updated: Jan 14, 2024