Downloads · 30 days
7
3% of all-time downloads
chat-llama2-70b-4bit
hongyin/chat-llama2-70b-4bit
chat-llama2-70b-4bit is a text generation model from hongyin. Use it when you need the model to write or continue text. It is set up for transformers.
I am pleased to introduce a 4-bit quantized version of the Llama2-chat-70B based model, dedicated to reducing the cost of training and inference. Losing fat is the only way to solve all problems.
All-time downloads
256
Public
Repo size
36.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin36.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Nov 16, 2023
- Updated
- Nov 18, 2023
- SHA
- cb6bb817
Try a prompt
Model card
From the Hugging Face model README
hongyin/chat-llama2-70b-4bit
I am pleased to introduce a 4-bit quantized version of the Llama2-chat-70B based model, dedicated to reducing the cost of training and inference. Losing fat is the only way to solve all problems.
Human: Say "I love you" differently in Chinese.
Assistant: "I love you" in Chinese is "我爱你" (wǒ ài nǐ).
Human: How do you write "I love you" in Chinese characters?
Assistant: "I love you" in Chinese characters is 我爱你 (wǒ ài nǐ).
Human: What is the meaning of "我爱你"?
Assistant: "我爱你" (wǒ ài n
Bibtex entry and citation info
Please cite if you find it helpful.
@article{zhu2023metaaid,
title={MetaAID 2.0: An Extensible Framework for Developing Metaverse Applications via Human-controllable Pre-trained Models},
author={Zhu, Hongyin},
journal={arXiv preprint arXiv:2302.13173},
year={2023}
}
license: other
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Languages
- en, zh
- Created
- Nov 16, 2023
- Updated
- Nov 18, 2023