Downloads · 30 days
2.1K
22% of all-time downloads
duyntnet/WizardLM-13B-V1.2-imatrix-GGUF
WizardLM-13B-V1.2-imatrix-GGUF is a text generation model from duyntnet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Quantizations of https://huggingface.co/WizardLMTeam/WizardLM-13B-V1.2
Downloads · 30 days
2.1K
22% of all-time downloads
All-time downloads
9.6K
Public
Repo size
179 GB
Likes
1
Public
Click a slice to open those files.
.gguf179 GB · 100%
From the Hugging Face model README
Quantizations of https://huggingface.co/WizardLMTeam/WizardLM-13B-V1.2
<b>Note for model system prompts usage:</b>
<b>WizardLM</b> adopts the prompt format from <b>Vicuna</b> and supports multi-turn conversation. The prompt should be as following:
A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: Hi ASSISTANT: Hello.</s>USER: Who are you? ASSISTANT: I am WizardLM.</s>......
We provide the inference WizardLM demo code here.
Please cite the paper if you use the data or code from WizardLM.