Downloads · 30 days
763
5% of all-time downloads
WizardLM-2-7B-imatrix-GGUF
duyntnet/WizardLM-2-7B-imatrix-GGUF
WizardLM-2-7B-imatrix-GGUF is a text generation model from duyntnet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Quantizations of https://huggingface.co/dreamgen/WizardLM-2-7B
All-time downloads
14K
Public
Repo size
89.9 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf89.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Access
- Public
- Created
- Apr 24, 2024
- Updated
- Apr 26, 2024
- SHA
- 1ae0e41d
Try a prompt
Model card
From the Hugging Face model README
Quantizations of https://huggingface.co/dreamgen/WizardLM-2-7B
From original readme
Usage
❗<b>Note for model system prompts usage:</b>
<b>WizardLM-2</b> adopts the prompt format from <b>Vicuna</b> and supports multi-turn conversation. The prompt should be as following:
A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful,
detailed, and polite answers to the user's questions. USER: Hi ASSISTANT: Hello.</s>
USER: Who are you? ASSISTANT: I am WizardLM.</s>......
<b> Inference WizardLM-2 Demo Script</b>
We provide a WizardLM-2 inference demo code on our github.
- Task
- Text Generation
- Library
- transformers
- License
- other
- Languages
- en
- Created
- Apr 24, 2024
- Updated
- Apr 26, 2024