Breeze-13B-32k-Instruct-v1_0

win10/Breeze-13B-32k-Instruct-v1_0

Breeze-13B-32k-Instruct-v1_0 is a text generation model from win10. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Breeze-13B-32k-Instruct-v10 is a merge of the following models using mergekit: MediaTek-Research/Breeze-7B-32k-Instruct-v10 MediaTek-Research/Breeze-7B-32k-Instruct-v10

Downloads · 30 days

345

40% of all-time downloads

All-time downloads

867

Public

Parameters

12.7B

25.5 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors25.5 GB · 100%

At a glance

Task: Text Generation
Library: transformers
License: apache-2.0
Model type: mistral
Access: Public
Created: Jun 26, 2024
Updated: Jun 26, 2024
SHA: 220c957c

Try a prompt

Model card

From the Hugging Face model README

Breeze-13B-32k-Instruct-v1_0

Breeze-13B-32k-Instruct-v1_0 is a merge of the following models using mergekit:

🧩 Configuration

dtype: bfloat16
merge_method: passthrough
slices:
- sources:
  - layer_range: [0, 8]
    model: MediaTek-Research/Breeze-7B-32k-Instruct-v1_0
- sources:
  - layer_range: [4, 12]
    model: MediaTek-Research/Breeze-7B-32k-Instruct-v1_0
- sources:
  - layer_range: [8, 16]
    model: MediaTek-Research/Breeze-7B-32k-Instruct-v1_0
- sources:
  - layer_range: [12, 20]
    model: MediaTek-Research/Breeze-7B-32k-Instruct-v1_0
- sources:
  - layer_range: [16, 24]
    model: MediaTek-Research/Breeze-7B-32k-Instruct-v1_0
- sources:
  - layer_range: [20, 28]
    model: MediaTek-Research/Breeze-7B-32k-Instruct-v1_0
- sources:
  - layer_range: [24, 32]
    model: MediaTek-Research/Breeze-7B-32k-Instruct-v1_0

Task: Text Generation
Library: transformers
Type: mistral
License: apache-2.0
Created: Jun 26, 2024
Updated: Jun 26, 2024