Downloads · 30 days
2.7K
13% of all-time downloads
dolphin-2.8-mistral-7b-v02-GGUF
QuantFactory/dolphin-2.8-mistral-7b-v02-GGUF
dolphin-2.8-mistral-7b-v02-GGUF is a text generation model from QuantFactory. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- This is GGUF quantized version, created using llama.cpp - Original model: cognitivecomputations/dolphin-2.8-mistral-7b-v02
All-time downloads
20.8K
Public
Repo size
70.7 GB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.gguf64.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Apr 4, 2024
- Updated
- Apr 7, 2024
- SHA
- caaf7ea4
Try a prompt
Base models
Model card
From the Hugging Face model README
Dolphin 2.8 Mistral 7b v0.2- GGUF
- This is GGUF quantized version, created using llama.cpp
- Original model: cognitivecomputations/dolphin-2.8-mistral-7b-v02
Description
This model is based on Mistral-7b-v0.2.
The base model has 32k context, and the full-weights fine-tune was with 16k sequence lengths.
Dolphin-2.8 has a variety of instruction, conversational, and coding skills.
Dolphin is uncensored. The dataset was filtered by the creators to remove alignment and bias. This makes the model more compliant. You are advised to implement your own alignment layer before exposing the model as a service. It will be highly compliant to any requests, even unethical ones. You are responsible for any content you create using this model.
Dolphin is licensed Apache 2.0. The creators grant permission for any use including commercial. Dolphin was trained on data generated from GPT4 among other models.
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- Apr 4, 2024
- Updated
- Apr 7, 2024