Downloads · 30 days
0
zatochu/llama-13b-pretrained-dropout-ggml-q4_0
llama-13b-pretrained-dropout-ggml-q4_0 is a machine learning model from zatochu. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Original model: https://huggingface.co/dvruette/llama-13b-pretrained-dropout
Downloads · 30 days
0
Access
Public
Updated Apr 14, 2023
Repo size
16.3 GB
Likes
2
Public
Click a slice to open those files.
.bin16.3 GB · 100%
From the Hugging Face model README
Original model: https://huggingface.co/dvruette/llama-13b-pretrained-dropout
4/13/23: Added new q4_0 quantization using https://github.com/ggerganov/llama.cpp/pull/896. (Edited to write the model with ftype 2 so it won't be incorrectly identified as 4 - mostly q4_1 some f16.)