Skip to content

LoneStriker

sparsetral-16x7B-v2-3.0bpw-h6-exl2

LoneStriker/sparsetral-16x7B-v2-3.0bpw-h6-exl2

sparsetral-16x7B-v2-3.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

- 8x A6000s - Forked version of unsloth for efficient training - Sequence Length: 4096 - Effective batch size: 128 - Learning Rate: 2e-5 with linear decay - Epochs: 1 - Base model trained with QLoRA (rank 64, alpha 16…

Downloads · 30 days

12

15% of all-time downloads

All-time downloads

81

Public

Repo size

3 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors3 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
sparsetral
Access
Public
Created
Feb 19, 2024
Updated
Feb 19, 2024
SHA
b06b086e

Try a prompt

Task
Text Generation
Library
transformers
Type
sparsetral
License
apache-2.0
Languages
en
Created
Feb 19, 2024
Updated
Feb 19, 2024