Downloads · 30 days
387
3% of all-time downloads
DeepSeek-V2.5-GGUF
second-state/DeepSeek-V2.5-GGUF
DeepSeek-V2.5-GGUF is a machine learning model from second-state. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
<div style="width: auto; margin-left: auto; margin-right: auto" <img src="https://github.com/LlamaEdge/LlamaEdge/raw/dev/assets/logo.svg" style="width: 100%; min-width: 400px; display: block; margin: auto;" </div <hr…
All-time downloads
11.2K
Public
Repo size
1.8 TB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf1.8 TB · 100%
At a glance
- License
- other
- Model type
- deepseek_v2
- Access
- Public
- Created
- Sep 12, 2024
- Updated
- Oct 16, 2024
- SHA
- fa5256bd
Base models
Model card
From the Hugging Face model README
<!-- header start -->
<!-- 200823 -->
<div style="width: auto; margin-left: auto; margin-right: auto">
<img src="https://github.com/LlamaEdge/LlamaEdge/raw/dev/assets/logo.svg" style="width: 100%; min-width: 400px; display: block; margin: auto;">
</div>
<hr style="margin-top: 1.0em; margin-bottom: 1.0em;">
<!-- header end -->
DeepSeek-V2.5-GGUF
Original Model
Run with LlamaEdge
- LlamaEdge version: coming soon
-
Prompt template
-
Prompt type:
deepseek-chat-25 -
Prompt string
<|begin_of_sentence|>{system_message}<|User|>{user_message_1}<|Assistant|>{assistant_message_1}<|end_of_sentence|><|User|>{user_message_2}<|Assistant|>
-
-
Context size:
128000 -
Run as LlamaEdge service
wasmedge --dir .:. \ --nn-preload default:GGML:AUTO:DeepSeek-V2.5-Q5_K_M.gguf \ llama-api-server.wasm \ --prompt-template deepseek-chat-25 \ --ctx-size 128000 \ --model-name DeepSeek-V2.5 -
Run as LlamaEdge command app
wasmedge --dir .:. \ --nn-preload default:GGML:AUTO:DeepSeek-V2.5-Q5_K_M.gguf \ llama-chat.wasm \ --prompt-template deepseek-chat-25 \ --ctx-size 128000
Quatized with llama.cpp b3664
- Type
- deepseek_v2
- License
- other
- Created
- Sep 12, 2024
- Updated
- Oct 16, 2024