Downloads · 30 days
27
5% of all-time downloads
falcon-7b-instruct-autogptq
Yhyu13/falcon-7b-instruct-autogptq
falcon-7b-instruct-autogptq is a text generation model from Yhyu13. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Genearted from https://github.com/yhyu13/AutoGPTQ.git branch cudadev
All-time downloads
516
Public
Repo size
4.8 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors4.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- RefinedWebModel
- Access
- Public
- Created
- May 27, 2023
- Updated
- May 27, 2023
- SHA
- d466d578
Try a prompt
Model card
From the Hugging Face model README
Genearted from https://github.com/yhyu13/AutoGPTQ.git branch cuda_dev
Original weight: https://huggingface.co/tiiuae/falcon-7b-instruct
Note, autogptq does not generate 128 group size successfully when evaluating, at this moment. So the group size is 64
- Task
- Text Generation
- Library
- transformers
- Type
- RefinedWebModel
- License
- apache-2.0
- Created
- May 27, 2023
- Updated
- May 27, 2023