Downloads · 30 days
26
3% of all-time downloads
laserxtral-sota-GGUF
Absolucy/laserxtral-sota-GGUF
laserxtral-sota-GGUF is a text generation model from Absolucy. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-2.0.
This is just, SOTA 2 and 3-bit quants for laserxtral. Not much more to it. Meow.
All-time downloads
1K
Public
Repo size
55.6 GB
Likes
16
Public
Repo makeup
Click a slice to open those files.
.gguf32.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-2.0
- Access
- Public
- Created
- Feb 10, 2024
- Updated
- Feb 12, 2024
- SHA
- bc764ace
Try a prompt
Base models
Model card
From the Hugging Face model README
This is just, SOTA 2 and 3-bit quants for laserxtral. Not much more to it. Meow.
The importance matrix, which is generated from group_10_merged.txt, is included in this repo, as imatrix_laserxtral.dat.
UPDATE 2/11/2024: The models have been reuploaded, with a new importance matrix used (group_10_merged.txt rather than 20k_random_data.txt), which should in theory provide better performance. I'm not an expert, don't quote me on that.
System Prompt
Alpaca format
### Instruction:
...
### Input:
...
### Response:
If you use LM Studio, this repo has a model_config.json you can import which has that pre-configured.
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-2.0
- Created
- Feb 10, 2024
- Updated
- Feb 12, 2024