Downloads · 30 days
0
nxnhjrjtbjfzhrovwl/hermes-limarp-13b-ggml-f16
hermes-limarp-13b-ggml-f16 is a machine learning model from nxnhjrjtbjfzhrovwl. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as agpl-3.0.
This repository contains the unquantized Hermes+LIMARP merge in ggml format.
Downloads · 30 days
0
Access
Public
Updated Aug 23, 2023
Repo size
26 GB
Likes
1
Public
Click a slice to open those files.
.bin26 GB · 100%
From the Hugging Face model README
This repository contains the unquantized Hermes+LIMARP merge in ggml format.
You can quantize the f16 ggml to the quantization of your choice by following the below steps:
quantize.exe hermes-limarp-13b.ggmlv3.f16.bin hermes-limarp-13b.ggmlv3.q4_0.bin q4_0