Skip to content

nisten

orpo-zephyr-8x22-EdgeQuants-gguf

nisten/orpo-zephyr-8x22-EdgeQuants-gguf

orpo-zephyr-8x22-EdgeQuants-gguf is a machine learning model from nisten. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

This is a handrolled quantization off of a custom but backwards compatible fork of llama.cpp Hoping to push edgequants to main llama.cpp repo soon

Downloads · 30 days

34

4% of all-time downloads

All-time downloads

821

Public

Repo size

315 GB

Likes

6

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.part0180 GB · 57%

At a glance

License
apache-2.0
Access
Public
Created
Apr 11, 2024
Updated
Apr 12, 2024
SHA
bbad105d

Base models

License
apache-2.0
Created
Apr 11, 2024
Updated
Apr 12, 2024