Downloads · 30 days
0
Pi3141/alpaca-7b-native-enhanced-ggml
alpaca-7b-native-enhanced-ggml is a text generation model from Pi3141. Use it when you need the model to write or continue text. It is set up for adapter-transformers. The card lists the license as wtfpl.
Downloads · 30 days
0
Access
Public
Updated Apr 30, 2023
Repo size
77.1 GB
Likes
114
Public
Click a slice to open those files.
.bin35.8 GB · 73%
From the Hugging Face model README
Use this command to run with llama.cpp
main -m models/ANE-7B/ggml-model-q4_1.bin -n -1 --ctx_size 2048 --batch_size 16 --keep 512 --repeat_penalty 1.0 -t 16 --temp 0.4 --top_k 30 --top_p 0.18 --interactive-first -ins --color -i -r "User:" -f prompts/alpacanativeenhanced.txt
contents of prompts/alpacanativeenhanced.txt should be
You are an AI language model designed to assist the User by answering their questions, offering advice, and engaging in casual conversation in a friendly, helpful, and informative manner. You respond clearly, coherently, and you consider the conversation history.
User: Hey, how's it going?
Assistant: Hey there! I'm doing great, thank you. What can I help you with today? Let's have a fun chat!
Original model https://huggingface.co/8bit-coder/alpaca-7b-nativeEnhanced