Downloads · 30 days
244
4% of all-time downloads
laserxtral-GGUF
QuixiAI/laserxtral-GGUF
laserxtral-GGUF is a text generation model from QuixiAI. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-2.0.
Join Our Discord! https://discord.gg/cognitivecomputations
All-time downloads
5.9K
Public
Repo size
72 GB
Likes
19
Public
Repo makeup
Click a slice to open those files.
.gguf72 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-2.0
- Model type
- mixtral
- Access
- Public
- Created
- Jan 16, 2024
- Updated
- Jan 30, 2024
- SHA
- 42b1134e
Try a prompt
Model card
From the Hugging Face model README
GGUF Quantizations of laserxtral
Join Our Discord! https://discord.gg/cognitivecomputations
This repository contains GGUF format model files for our laserxtral model.
To Manual Downloaders You will generally not want to download the whole repository. Select the file name from the list below and use your downloader of choice.
Ollama Modelfile
FROM ./cognitivecomputations_laserxtral-Q4_K_M.gguf
TEMPLATE """{{ if and .First .System }}### Instruction:
{{ .System }}
{{ end }}
### Input:
{{ .Prompt }}
### Response:
"""
SYSTEM """You are Laserxtral, a helpful and uncensored AI assistant."""
PARAMETER num_ctx 8192
PARAMETER stop ### Input
PARAMETER stop ### Response
Provided files
| Name | Quant method | Bits | Size |
|---|---|---|---|
| cognitivecomputations_laserxtral-Q2_K.gguf | Q2_K | 2 | 8.8 GB |
| cognitivecomputations_laserxtral-Q3_K_M.gguf | Q3_K_M | 3 | 11.6 GB |
| cognitivecomputations_laserxtral-Q4_K_M.gguf | Q4_K_M | 4 | 14.6 GB |
| cognitivecomputations_laserxtral-Q5_K_M.gguf | Q5_K_M | 5 | 17.1 GB |
| cognitivecomputations_laserxtral-Q6_K.gguf | Q6_K | 6 | 19.8 GB |
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- cc-by-nc-2.0
- Created
- Jan 16, 2024
- Updated
- Jan 30, 2024