Downloads · 30 days
0
Aspik101/trurl-2-7b-GGML
trurl-2-7b-GGML is a text generation model from Aspik101. Use it when you need the model to write or continue text. The card lists the license as other.
GGML Format model files for This project.
Downloads · 30 days
0
Access
Public
Updated Aug 16, 2023
Repo size
24.9 GB
Likes
2
Public
Click a slice to open those files.
.bin24.9 GB · 100%
From the Hugging Face model README
GGML Format model files for This project.
import ctransformers
from ctransformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("Aspik101/trurl-2-7b-GGML",model_type="llama")
prompt = "Yesterday, when I was"
llm(prompt_input,
max_new_tokens=256,
temperature=0.9,
top_p= 0.7)