RedPajama-INCITE-Chat-Instruct-3B-V1

acrastt/RedPajama-INCITE-Chat-Instruct-3B-V1

RedPajama-INCITE-Chat-Instruct-3B-V1 is a text generation model from acrastt. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

<a href="https://www.buymeacoffee.com/acrastt" target="blank"<img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" </a

Downloads · 30 days

105

0% of all-time downloads

All-time downloads

55.4K

Public

Parameters

2.8B

11.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin5.6 GB · 50%

At a glance

Task: Text Generation
Library: transformers
License: apache-2.0
Model type: gpt_neox
Access: Public
Created: Jul 27, 2023
Updated: Feb 3, 2024
SHA: 8d387309

Try a prompt

Datasets

Spaces

30 linked

Model card

From the Hugging Face model README

This is an experimental merge of models RedPajama-INCITE-Chat-3B-V1 and RedPajama-INCITE-Instruct-3B-V1.</br> This model is adaptive to prompt templates, but this template is recommended:

HUMAN: {prompt}
ASSISTANT:

Feel free to change HUMAN or ASSISTANT. It will not change much.</br> GGML versions here (Note that this is only compatible with koboldcpp).

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	39.23
ARC (25-shot)	42.58
HellaSwag (10-shot)	67.48
MMLU (5-shot)	25.99
TruthfulQA (0-shot)	33.62
Winogrande (5-shot)	64.8
GSM8K (5-shot)	0.91

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	39.23
AI2 Reasoning Challenge (25-Shot)	42.58
HellaSwag (10-Shot)	67.48
MMLU (5-Shot)	25.99
TruthfulQA (0-shot)	33.62
Winogrande (5-shot)	64.80
GSM8k (5-shot)	0.91

Task: Text Generation
Library: transformers
Type: gpt_neox
License: apache-2.0
Languages: en
Created: Jul 27, 2023
Updated: Feb 3, 2024