Downloads · 30 days
226
14% of all-time downloads
Locutusque_-_Hyperion-2.1-Mistral-7B-gguf
RichardErkhov/Locutusque_-_Hyperion-2.1-Mistral-7B-gguf
Locutusque_-_Hyperion-2.1-Mistral-7B-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
1.6K
Public
Repo size
82.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf95.2 GB · 100%
At a glance
- Access
- Public
- Created
- Sep 12, 2024
- Updated
- Sep 12, 2024
- SHA
- 4ff50f37
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
Hyperion-2.1-Mistral-7B - GGUF
- Model creator: https://huggingface.co/Locutusque/
- Original model: https://huggingface.co/Locutusque/Hyperion-2.1-Mistral-7B/
Original model description:
library_name: transformers license: apache-2.0 datasets:
- Locutusque/hyperion-v2.0 language:
- en
Description
Further fine-tuned Locutusque/Hyperion-2.0-Mistral-7B at a higher learning rate. This was done to see if performance increased. Read Locutusque/Hyperion-2.0-Mistral-7B's model card for more information. Slight performance gain was observed. More checkpoints will be released in the future.
Disclaimer
This model is very compliant. It will respond to any request without refusal. If you intend to deploy this model at an enterprise level, I would recommend aligning this model using DPO.
Quants
ExLlamaV2: https://huggingface.co/bartowski/Hyperion-2.1-Mistral-7B-exl2
GGUF: https://huggingface.co/bartowski/Hyperion-2.1-Mistral-7B-GGUF
AWQ: https://huggingface.co/solidrust/Hyperion-2.1-Mistral-7B-AWQ
- Created
- Sep 12, 2024
- Updated
- Sep 12, 2024