test3_sft_4bit

alnrg2arg/test3_sft_4bit

test3_sft_4bit is a text generation model from alnrg2arg. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.

Downloads · 30 days

0% of all-time downloads

All-time downloads

7.2K

Public

Parameters

7.2B

14.5 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors14.5 GB · 100%

At a glance

Task: Text Generation
Library: transformers
License: cc-by-nc-4.0
Model type: mistral
Access: Public
Created: Jan 26, 2024
Updated: Jan 27, 2024
SHA: b69a40f2

Try a prompt

Base models

alnrg2arg/blockchainlabs_7B_merged_test2_4

Datasets

Open-Orca/SlimOrca

Model card

From the Hugging Face model README

Benchmark Scores

Tasks	Version	Filter	n-shot	Metric	Value		Stderr
arc_challenge	1	none	0	acc	0.5247	±	0.0146
		none	0	acc_norm	0.5623	±	0.0145

Tasks	Version	Filter	n-shot	Metric	Value		Stderr
hellaswag	1	none	0	acc	0.6270	±	0.0048
		none	0	acc_norm	0.8228	±	0.0038

Groups	Version	Filter	Metric	Value		Stderr
mmlu	N/A	none	acc	0.6243	±	0.1341
- humanities	N/A	none	acc	0.5717	±	0.1400
- other	N/A	none	acc	0.7016	±	0.1143
- social_sciences	N/A	none	acc	0.7342	±	0.0753
- stem	N/A	none	acc	0.5192	±	0.1257

Tasks	Version	Filter	n-shot	Metric	Value		Stderr
winogrande	1	none	0	acc	0.7774	±	0.0117

Tasks	Version	Filter	n-shot	Metric	Value		Stderr
gsm8k	2	get-answer	5	exact_match	0.6732	±	0.0129

Tasks	Version	Filter	n-shot	Metric	Value		Stderr
truthfulqa_mc2	2	none	0	acc	0.4795	±	0.0148

Average 65.658

Task: Text Generation
Library: transformers
Type: mistral
License: cc-by-nc-4.0
Languages: en
Created: Jan 26, 2024
Updated: Jan 27, 2024