Downloads · 30 days
0
dolly-v2-12b-q4
snphs/dolly-v2-12b-q4
dolly-v2-12b-q4 is a text generation model from snphs. Use it when you need the model to write or continue text. The card lists the license as mit.
dolly-v2-12b converted to GGML format and quantized to 4-bit using https://github.com/NolanoOrg/cformers.
Access
Public
Updated Apr 15, 2023
Repo size
7.4 GB
Likes
13
Public
Repo makeup
Click a slice to open those files.
.bin7.4 GB · 100%
At a glance
- Task
- Text Generation
- License
- mit
- Access
- Public
- Created
- Apr 13, 2023
- Updated
- Apr 15, 2023
- SHA
- c0195857
Try a prompt
Model card
From the Hugging Face model README
dolly-v2-12b-q4 Model Card
dolly-v2-12b converted to GGML format and quantized to 4-bit using https://github.com/NolanoOrg/cformers.
Running the model
This fork has the modification that includes Dolly in the model list.
from interface import AutoInference as AI
ai = AI("databricks/dolly-v2-12b")
prompt_template = """Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{instruction}
### Response:
"""
instruction = "Explain to me the difference between nuclear fission and fusion."
x = ai.generate(prompt_template.format(instruction=instruction), num_tokens_to_generate=100)
print(x['token_str'])
- Task
- Text Generation
- License
- mit
- Languages
- en
- Created
- Apr 13, 2023
- Updated
- Apr 15, 2023