Downloads · 30 days
0
chinese-llama-alpaca-2-awq
hfl/chinese-llama-alpaca-2-awq
chinese-llama-alpaca-2-awq is a machine learning model from hfl. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This folder contains pre-computed search results for Chinese-LLaMA-2 and Chinese-Alpaca-2 models, which is used to generate AWQ (Activation-aware Weight Quantization) models.
Access
Public
Updated Dec 29, 2023
Repo size
1.1 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.pt1.1 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Dec 28, 2023
- Updated
- Dec 29, 2023
- SHA
- 2d1e60ca
Model card
From the Hugging Face model README
This folder contains pre-computed search results for Chinese-LLaMA-2 and Chinese-Alpaca-2 models, which is used to generate AWQ (Activation-aware Weight Quantization) models.
WARNING: These models MUST BE used with the original weights.
For usage, see:
- AWQ official github page: https://github.com/mit-han-lab/llm-awq
- llama.cpp github page: https://github.com/ggerganov/llama.cpp/tree/master/awq-py
- License
- apache-2.0
- Languages
- zh, en
- Created
- Dec 28, 2023
- Updated
- Dec 29, 2023