Skip to content

adamo1139

Yi-34B-200K-XLCTX-RAW-ORPO-0805-GaLore

adamo1139/Yi-34B-200K-XLCTX-RAW-ORPO-0805-GaLore

Yi-34B-200K-XLCTX-RAW-ORPO-0805-GaLore is a text generation model from adamo1139. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Finetune of Yi-34B-200K (the version with better ctx, Yi-34B-200K v2 or Yi-34B-200K-XLCTX (my preffered name)) on adamo1139/rawrrv22stage1 dataset via ORPO and GaLore on 4-bit (bnb) weights.

Downloads · 30 days

10

10% of all-time downloads

All-time downloads

96

Public

Parameters

34.4B

68.8 GB on disk

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors68.8 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
llama
Access
Public
Created
May 8, 2024
Updated
May 27, 2024
SHA
20572b16

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
License
apache-2.0
Created
May 8, 2024
Updated
May 27, 2024