Downloads · 30 days
1.6K
12% of all-time downloads
EssentialAI/rnj-1-instruct-GGUF
rnj-1-instruct-GGUF is a machine learning model from EssentialAI. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This is a GGUF-formatted checkpoint of rnj-1-instruct suitable for use in llama.cpp, Ollama, or others. This has been quantized with the Q4\K\M scheme, which results in model weights of size 4.8GB.
Downloads · 30 days
1.6K
12% of all-time downloads
All-time downloads
13.6K
Public
Repo size
20.5 GB
Likes
53
Public
Click a slice to open those files.
.gguf5.1 GB · 100%
From the Hugging Face model README
This is a GGUF-formatted checkpoint of rnj-1-instruct suitable for use in llama.cpp, Ollama, or others. This has been quantized with the Q4_K_M scheme, which results in model weights of size 4.8GB.
For llama.cpp, install (after version 7328, e.g., on Mac OSX brew install llama.cpp) and run either of these commands:
llama-cli -hf EssentialAI/rnj-1-instruct-GGUF
llama-server -hf EssentialAI/rnj-1-instruct-GGUF -c 0 # and open browser to localhost:8080
For Ollama, install (after version v0.13.3 -- versions can be found here) and run:
ollama run rnj-1