Downloads · 30 days
0
OpenLLaMA_7B_300BT_q4
rozek/OpenLLaMA_7B_300BT_q4
OpenLLaMA_7B_300BT_q4 is a text generation model from rozek. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This repository contains the 300BT preview of the Open LLaMA model based on the RedPajama 1T dataset, converted to GGML and quantized to 4 bit, ready to be used with llama.cpp
Access
Public
Updated May 5, 2023
Repo size
4.2 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin4.2 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- May 5, 2023
- Updated
- May 5, 2023
- SHA
- 09cf0c59
Try a prompt
Model card
From the Hugging Face model README
This repository contains the 300BT preview of the Open LLaMA model based on the RedPajama 1T dataset, converted to GGML and quantized to 4 bit, ready to be used with llama.cpp
Usage
In order to use this model with llama.cpp
- install llama.cpp as described in the docs
- download this model
- move it into the
modelssubfolder of llama.cpp - run inferences with the additional parameter
-m ./models/7B/ggml-openllama-7b-300bt-q4_0.bin
For example,
./main -m ./models/7B/ggml-openllama-7b-300bt-q4_0.bin -n 128 -p "who was Joseph Weizenbaum?"
License
Since the underlying model is itself Apache 2.0 licensed, this repo is as well.
license: apache-2.0
- Task
- Text Generation
- License
- apache-2.0
- Created
- May 5, 2023
- Updated
- May 5, 2023