Llama-3-8B-NLI-ties3

pwei07/Llama-3-8B-NLI-ties3

Llama-3-8B-NLI-ties3 is a text generation model from pwei07. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Llama-3-8B-NLI-ties3 is a merge of the following models using mergekit: /content/drive/MyDrive/llama3anli1rationaleftpretrained /content/drive/MyDrive/llama3labelrationalepretrained3

Downloads · 30 days

13% of all-time downloads

All-time downloads

Public

Parameters

16.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors16.1 GB · 100%

At a glance

Task: Text Generation
Library: transformers
License: apache-2.0
Model type: llama
Access: Public
Created: Apr 24, 2024
Updated: Apr 24, 2024
SHA: 03b2a2c5

Try a prompt

Model card

From the Hugging Face model README

Llama-3-8B-NLI-ties3

Llama-3-8B-NLI-ties3 is a merge of the following models using mergekit:

🧩 Configuration

models:
  - model: /content/drive/MyDrive/llama3_anli1_rationale_ft_pretrained
    parameters:
      density: 1
      weight: 0.5
  - model: /content/drive/MyDrive/llama3_label_rationale_pretrained3
    parameters:
      density: 1
      weight: 0.5
  # - model: WizardLM/WizardMath-13B-V1.0
  #   parameters:
  #     density: 0.33
  #     weight:
  #       - filter: mlp
  #         value: 0.5
  #       - value: 0
merge_method: ties
base_model: /content/drive/MyDrive/Meta-Llama-3-8B-Instruct
parameters:
  normalize: true
  int8_mask: true
dtype: float16

Task: Text Generation
Library: transformers
Type: llama
License: apache-2.0
Created: Apr 24, 2024
Updated: Apr 24, 2024