Index-1.9B-Constant-LR

IndexTeam/Index-1.9B-Constant-LR

Index-1.9B-Constant-LR is a text generation model from IndexTeam. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.

<div align="center" <h1 Index-1.9B-Constant-LR </h1 </div

Downloads · 30 days

1% of all-time downloads

All-time downloads

925

Public

Repo size

8.7 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin4.3 GB · 100%

At a glance

Task: Text Generation
Library: transformers
License: other
Model type: index
Access: Public
Created: Jun 19, 2024
Updated: Jun 27, 2024
SHA: 0516a319

Try a prompt

Model card

From the Hugging Face model README

<div align="center"> <h1> Index-1.9B-Constant-LR </h1> </div>

Model Introduction

This repository Index-1.9B-Constant-LR is the checkpoint file of the Index-1.9B base model before decay training, which is provided for everyone to conduct research on downstream tasks.

For more details, see our GitHub and Index-1.9B Technical Report

Evaluation Results

Here we add the evaluation of the general understanding ability of the Index-1.9B-Constant-LR model

Model	Average score	Average English score	MMLU	CEVAL	CMMLU	HellaSwag	Arc-C	Arc-E
Index-1.9B-Constant-LR	41.47	44.24	35.30	38.58	33.26	59.94	32.96	48.75
Index-1.9B-Pure	49.55	52.83	43.75	42.35	43.61	63.21	42.75	61.61
Index-1.9B	64.92	69.93	52.53	57.01	52.79	80.69	65.15	81.35

Evaluation code is based on OpenCompass with compatibility modifications. See the evaluate folder for details.

Task: Text Generation
Library: transformers
Type: index
License: other
Created: Jun 19, 2024
Updated: Jun 27, 2024