Downloads · 30 days
8
19% of all-time downloads
Meta-Llama-3.1-70B-bnb-4bits
LlamaFinetune/Meta-Llama-3.1-70B-bnb-4bits
Meta-Llama-3.1-70B-bnb-4bits is a text generation model from LlamaFinetune. Use it when you need the model to write or continue text. It is set up for transformers.
Below is the orginal model card as this is just a 4-bit version of that.
All-time downloads
43
Public
Parameters
71.6B
42.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors42.7 GB · 100%
Parameter types
How the weights are stored.
U868.5B · 96%
Try a prompt
Model card
From the Hugging Face model README
Model Card for Model ID
Below is the orginal model card as this is just a 4-bit version of that.
Model Details
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Sep 17, 2024
- Updated
- Sep 17, 2024