Downloads · 30 days
18
3% of all-time downloads
chimera-7b-4bit-128g
CyberTimon/chimera-7b-4bit-128g
chimera-7b-4bit-128g is a text generation model from CyberTimon. Use it when you need the model to write or continue text. It is set up for transformers.
All credits go to this amazing project: https://github.com/FreedomIntelligence/LLMZoo
All-time downloads
636
Public
Repo size
4 GB
Likes
7
Public
Repo makeup
Click a slice to open those files.
.pt4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Apr 25, 2023
- Updated
- May 6, 2023
- SHA
- 921b8c28
Try a prompt
Model card
From the Hugging Face model README
This is the 4bit converted version for use with oobabooga's text-generation-webui.
All credits go to this amazing project: https://github.com/FreedomIntelligence/LLMZoo
This is the chat-instruct version
Converted with python llama.py ./chimera-7b c4 --wbits 4 --true-sequential --groupsize 128 --save chimera7b-4bit-128g.pt
It uses groupsize 128. Doesn't use act-order and got quantized with the oobabooga gpt-q branch so it works there.
Anyone need a 13b version? (Edit: Can't do it right now as I only get out of memory errors while quantizing.)
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Apr 25, 2023
- Updated
- May 6, 2023