Downloads · 30 days
18
4% of all-time downloads
Yhyu13/falcon-7b-autogptq
falcon-7b-autogptq is a text generation model from Yhyu13. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Genearted from https://github.com/yhyu13/AutoGPTQ.git branch cudadev
Downloads · 30 days
18
4% of all-time downloads
All-time downloads
457
Public
Repo size
4.8 GB
Likes
2
Public
Click a slice to open those files.
.safetensors4.8 GB · 100%
From the Hugging Face model README
Genearted from https://github.com/yhyu13/AutoGPTQ.git branch cuda_dev
Original weight: https://huggingface.co/tiiuae/falcon-7b
Note this is the quantization of the base model, where base model is not fined-tuned with chat instructions yet