Skip to content

bhenrym14

airoboros-7b-gpt4-1.4.1-lxctx-PI-16384-fp16

bhenrym14/airoboros-7b-gpt4-1.4.1-lxctx-PI-16384-fp16

airoboros-7b-gpt4-1.4.1-lxctx-PI-16384-fp16 is a text generation model from bhenrym14. Use it when you need the model to write or continue text. It is set up for transformers.

This is Jon Durbin's Airoboros 7B GPT4 1.4 (fp16) with several key modifications: - Context length extended to 16384 by RoPE Scaled Embeddings. - The Llama-7b base model is pretrained for additional 150 steps on 16384…

Downloads · 30 days

17

15% of all-time downloads

All-time downloads

110

Public

Parameters

6.7B

13.5 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors13.5 GB · 100%

Parameter types

How the weights are stored.

F166.7B · 100%

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
Created
Jul 10, 2023
Updated
Jul 10, 2023