Downloads · 30 days
12
4% of all-time downloads
genz-13b-v2-ggml
budecosystem/genz-13b-v2-ggml
genz-13b-v2-ggml is a text generation model from budecosystem. Use it when you need the model to write or continue text. It is set up for transformers.
The instruction finetuned model with 4K input length. The model is finetuned on top of pretrained LLaMa2
All-time downloads
336
Public
Repo size
7.4 GB
Likes
5
Public
Repo makeup
Click a slice to open those files.
.bin7.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Jul 27, 2023
- Updated
- Sep 6, 2023
- SHA
- d67ae14f
Try a prompt
Model card
From the Hugging Face model README
GenZ 13B v2 GGML
The instruction finetuned model with 4K input length. The model is finetuned on top of pretrained LLaMa2
Inference
import ctransformers
from ctransformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained('budecosystem/genz-13b-v2-ggml', model_type="llama")
prompt = """A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.
USER: who are you? ASSISTANT: """
print(model(prompt))
Support LM Studio for Mac & Windows users
Use following prompt template
A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: Hi, how are you? ASSISTANT:
Check the GitHub for the code -> GenZ
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Languages
- en
- Created
- Jul 27, 2023
- Updated
- Sep 6, 2023