Sashkanik13

safetensors_rugpt3small

Sashkanik13/safetensors_rugpt3small

safetensors_rugpt3small is a text generation model from Sashkanik13. Use it when you need the model to write or continue text. It is set up for transformers.

Model was trained with sequence length 1024 using transformers by SberDevices team on 80B tokens around 3 epoch. After that model was finetuned on 2048 context.