Downloads · 30 days
30
2% of all-time downloads
cognitivecomputations_-_laserxtral-gguf
RichardErkhov/cognitivecomputations_-_laserxtral-gguf
cognitivecomputations_-_laserxtral-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
1.8K
Public
Repo size
272 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf316 GB · 100%
At a glance
- Access
- Public
- Created
- Sep 1, 2024
- Updated
- Sep 1, 2024
- SHA
- 837eb516
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
laserxtral - GGUF
- Model creator: https://huggingface.co/cognitivecomputations/
- Original model: https://huggingface.co/cognitivecomputations/laserxtral/
| Name | Quant method | Size |
|---|---|---|
| laserxtral.Q2_K.gguf | Q2_K | 8.24GB |
| laserxtral.IQ3_XS.gguf | IQ3_XS | 9.21GB |
| laserxtral.IQ3_S.gguf | IQ3_S | 9.73GB |
| laserxtral.Q3_K_S.gguf | Q3_K_S | 9.72GB |
| laserxtral.IQ3_M.gguf | IQ3_M | 9.92GB |
| laserxtral.Q3_K.gguf | Q3_K | 10.79GB |
| laserxtral.Q3_K_M.gguf | Q3_K_M | 10.79GB |
| laserxtral.Q3_K_L.gguf | Q3_K_L | 11.68GB |
| laserxtral.IQ4_XS.gguf | IQ4_XS | 12.15GB |
| laserxtral.Q4_0.gguf | Q4_0 | 12.69GB |
| laserxtral.IQ4_NL.gguf | IQ4_NL | 12.81GB |
| laserxtral.Q4_K_S.gguf | Q4_K_S | 12.8GB |
| laserxtral.Q4_K.gguf | Q4_K | 13.61GB |
| laserxtral.Q4_K_M.gguf | Q4_K_M | 13.61GB |
| laserxtral.Q4_1.gguf | Q4_1 | 14.09GB |
| laserxtral.Q5_0.gguf | Q5_0 | 15.48GB |
| laserxtral.Q5_K_S.gguf | Q5_K_S | 15.48GB |
| laserxtral.Q5_K.gguf | Q5_K | 15.96GB |
| laserxtral.Q5_K_M.gguf | Q5_K_M | 15.96GB |
| laserxtral.Q5_1.gguf | Q5_1 | 16.88GB |
| laserxtral.Q6_K.gguf | Q6_K | 18.46GB |
| laserxtral.Q8_0.gguf | Q8_0 | 23.9GB |
Original model description:
license: cc-by-nc-2.0
by David, Fernando and Eric
Sponsored by: VAGO Solutions
An experimentation regarding 'lasering' each expert to denoise and enhance model capabilities.
This model has half size in comparison to the Mixtral 8x7b Instruct. And it basically has the same level of performance (we are working to get a better MMLU score).
Laserxtral - 4x7b (all, except for base, lasered using laserRMT)
This model is a Mixture of Experts (MoE) made with mergekit (mixtral branch). It uses the following base models:
- cognitivecomputations/dolphin-2.6-mistral-7b-dpo
- mlabonne/Marcoro14-7B-slerp (base)
- beowolx/CodeNinja-1.0-OpenChat-7B
- Q-bert/MetaMath-Cybertron-Starling
- WizardLM/WizardMath-7B-V1.1
It follows the implementation of laserRMT @ https://github.com/cognitivecomputations/laserRMT
Here, we are controlling layers checking which ones have lower signal to noise ratios (which are more subject to noise), to apply Laser interventions, still using Machenko Pastur to calculate this ratio.
We intend to be the first of a family of experimentations being carried out @ Cognitive Computations.
In this experiment we have observed very high truthfulness and high reasoning capabilities.
Evals
- Created
- Sep 1, 2024
- Updated
- Sep 1, 2024