Downloads · 30 days
29
4% of all-time downloads
Phoenix_DPO_60B_gguf
cloudyu/Phoenix_DPO_60B_gguf
Phoenix_DPO_60B_gguf is a machine learning model from cloudyu. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repo contains GGUF format model files for cloudyu/PhoenixDPO60B.
All-time downloads
799
Public
Repo size
59 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf59 GB · 100%
At a glance
- Access
- Public
- Created
- Feb 1, 2024
- Updated
- Feb 1, 2024
- SHA
- 72754eef
Model card
From the Hugging Face model README
Description
This repo contains GGUF format model files for cloudyu/Phoenix_DPO_60B.
<!-- description end --> <!-- README_GGUF.md-about-gguf start -->About GGUF
GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
How to run GGUF with llama.cpp on an A10 (24G vram)
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp/
make LLAMA_CUBLAS=1
./main --model ./cloudyu_Phoenix_DPO_60B.Q3_K_XS.gguf -p "what is biggest animal?" -i -ngl 36
- Created
- Feb 1, 2024
- Updated
- Feb 1, 2024