Downloads · 30 days
15
4% of all-time downloads
baize_lora_q4_ggml
couchpotato888/baize_lora_q4_ggml
baize_lora_q4_ggml is a text generation model from couchpotato888. Use it when you need the model to write or continue text. It is set up for transformers.
To run this model, please clone: https://github.com/ggerganov/llama.cpp and install using Make (see instruction in Github)
All-time downloads
364
Public
Repo size
8.1 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin8.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Apr 17, 2023
- Updated
- Apr 18, 2023
- SHA
- 096f58a7
Try a prompt
Model card
From the Hugging Face model README
To run this model, please clone: https://github.com/ggerganov/llama.cpp and install using Make (see instruction in Github)
Then, download the model and place it in the models folder and run:
Linux: ./main -m models/baize_lora_13b_q4.bin -n -1 -t 4 --ignore-eos --temp 0.4 --interactive-first --repeat_penalty 1.2 --instruct --color
Windows: main.exe -m models/baize_lora_13b_q4.bin -n -1 -t 4 --ignore-eos --temp 0.4 --interactive-first --repeat_penalty 1.2 --instruct --color
It should look something like this:
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Apr 17, 2023
- Updated
- Apr 18, 2023