Downloads · 30 days
30
29% of all-time downloads
chenshake/Llama-2-7b-hf-GGUF
Llama-2-7b-hf-GGUF is a machine learning model from chenshake. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Downloads · 30 days
30
29% of all-time downloads
All-time downloads
103
Public
Repo size
8.9 GB
Likes
1
Public
Click a slice to open those files.
.gguf8.9 GB · 100%
From the Hugging Face model README
从Llama-2-7b-hf,转换成gguf格式。
notebook:
quantize-llama-2-models-using-gguf
我使用作者的colab,做了一些调整,记得要T4,不然转换的时候会出错。
使用量化后gguf模型,进行推理测试.notebook: