Downloads · 30 days
101
0% of all-time downloads
dolphin-2.9.3-mistral-7B-32K-GGUF
macadeliccc/dolphin-2.9.3-mistral-7B-32K-GGUF
dolphin-2.9.3-mistral-7B-32K-GGUF is a machine learning model from macadeliccc. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
All-time downloads
33.8K
Public
Repo size
41.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf41.7 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jun 25, 2024
- Updated
- Jun 25, 2024
- SHA
- e4825da6
Base models
Model card
From the Hugging Face model README
Original Model Card
Dolphin 2.9.3 Mistral 7b v0.3 32k 🐬
Curated and trained by Eric Hartford and Cognitive Computations
This model is based on mistralai/Mistral-7B-v0.3, and is governed by the apache 2.0 license.
The base model has 32k context, and our finetuning took place with 8192 sequence length.
Dolphin 2.9.3 uses ChatML prompt template format.
example:
<|im_start|>system
You are Dolphin, a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
Usage
ollama run CognitiveComputations/dolphin-mistral-32k:7b-v2.9.3-q4_0
Supported Tags
- dolphin-mistral-32k:7b-v2.9.3-q2_k
- dolphin-mistral-32k:7b-v2.9.3-q3_k
- dolphin-mistral-32k:7b-v2.9.3-q4_0
- dolphin-mistral-32k:7b-v2.9.3-q4_k_m
- dolphin-mistral-32k:7b-v2.9.3-q4_k_s
- dolphin-mistral-32k:7b-v2.9.3-q5_0
- dolphin-mistral-32k:7b-v2.9.3-q5_k_m
- dolphin-mistral-32k:7b-v2.9.3-q5_k_s
- dolphin-mistral-32k:7b-v2.9.3-q6_k
- dolphin-mistral-32k:7b-v2.9.3-q8_0
- License
- apache-2.0
- Created
- Jun 25, 2024
- Updated
- Jun 25, 2024