Downloads · 30 days
20
2% of all-time downloads
CodeLlama-7b-hf-4bit
cmarkea/CodeLlama-7b-hf-4bit
CodeLlama-7b-hf-4bit is a text generation model from cmarkea. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
Converted version of CodeLlama-7b to 4-bit using bitsandbytes. For more information about the model, refer to the model's page.
All-time downloads
831
Public
Parameters
6.9B
3.9 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors3.9 GB · 100%
Parameter types
How the weights are stored.
U86.7B · 96%
Try a prompt
Model card
From the Hugging Face model README
Converted version of CodeLlama-7b to 4-bit using bitsandbytes. For more information about the model, refer to the model's page.
Impact on performance
In the following figure, we can see the impact on the performance of a set of models relative to the required RAM space. It is noticeable that the quantized models have equivalent performance while providing a significant gain in RAM usage.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Created
- Aug 14, 2024
- Updated
- Aug 14, 2024