Downloads · 30 days
18
4% of all-time downloads
mpt-7b-chat-quant
mgoin/mpt-7b-chat-quant
mpt-7b-chat-quant is a text generation model from mgoin. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
436
Public
Repo size
6.9 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.data6.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- mpt
- Access
- Public
- Created
- Sep 20, 2023
- Updated
- Sep 20, 2023
- SHA
- 4107122b
Try a prompt
Model card
From the Hugging Face model README
mpt_7b_chat-dense_quant_linearW8A8MatMul8Embeds8LMhead8
import deepsparse
from huggingface_hub import snapshot_download
MODEL_PATH = snapshot_download(repo_id="mgoin/mpt-7b-chat-quant")
model = deepsparse.Pipeline.create(task="text-generation", model_path=MODEL_PATH)
model(sequences="Tell me a joke.")
- Task
- Text Generation
- Library
- transformers
- Type
- mpt
- Created
- Sep 20, 2023
- Updated
- Sep 20, 2023