solar-merge-awq

antiven0m/solar-merge-awq

solar-merge-awq is a text generation model from antiven0m. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Downloads · 30 days

14% of all-time downloads

All-time downloads

Public

Parameters

10.7B

6 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors6 GB · 100%

Parameter types

How the weights are stored.

I3210.5B · 98%

Try a prompt

Base models

Model card

From the Hugging Face model README

models:
  - model: upstage/SOLAR-10.7B-v1.0
  - model: Undi95/Borealis-10.7B-DPO
    parameters:
      density: 0.6
      weight: 0.4
  - model: Sao10K/Sensualize-Solar-10.7B
    parameters:
      density: 0.5
      weight: 0.3
  - model: maywell/PiVoT-SOLAR-10.7B-RP
    parameters:
      density: 0.5
      weight: 0.3
merge_method: dare_ties
base_model: upstage/SOLAR-10.7B-v1.0
parameters:
  int8_mask: true
dtype: bfloat16
name: ties

Task: Text Generation
Library: transformers
Type: llama
License: apache-2.0
Languages: en
Created: Jan 27, 2024
Updated: Jan 27, 2024