Skip to content

adamo1139

LWM-7B-1M-1000000ctx-AEZAKMI-3_1-1702

adamo1139/LWM-7B-1M-1000000ctx-AEZAKMI-3_1-1702

LWM-7B-1M-1000000ctx-AEZAKMI-3_1-1702 is a text generation model from adamo1139. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.

LargeWorldModel 7B 1000000 ctx finetuned on AEZAKMI v3.1 dataset for epochs at maxseqlen of 4000 using QLoRA with lorar 32 and cosine lr decaying from 0.00015. I will be uploading exl2 quants and base model in safeten…

Downloads · 30 days

54

0% of all-time downloads

All-time downloads

11.3K

Public

Parameters

6.7B

13.5 GB on disk

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors13.5 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
llama2
Model type
llama
Access
Public
Created
Feb 17, 2024
Updated
Feb 17, 2024
SHA
fdb67879

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
License
llama2
Created
Feb 17, 2024
Updated
Feb 17, 2024