Downloads · 30 days
22
2% of all-time downloads
falcon-7b-instruct-8bit
inarikami/falcon-7b-instruct-8bit
falcon-7b-instruct-8bit is a text generation model from inarikami. Use it when you need the model to write or continue text. It is set up for transformers.
This repository is home to the Falcon-7B-Instruct model, which has been carefully converted from its original 32-bit mode to an efficient and compact 8-bit mode.
All-time downloads
1.5K
Public
Repo size
6.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin6.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- RefinedWebModel
- Access
- Public
- Created
- Jun 18, 2023
- Updated
- Jul 9, 2023
- SHA
- 59757293
Try a prompt
Model card
From the Hugging Face model README
Falcon-7B-Instruct 8-bit Model
This repository is home to the Falcon-7B-Instruct model, which has been carefully converted from its original 32-bit mode to an efficient and compact 8-bit mode.
Usage
You can use this model directly with a pipeline for tasks such as text generation and instruction following:
from transformers import pipeline
generator = pipeline('text-generation', model='tensorcat/falcon-7b-instruct-8bit')
print(generator("Generate a story about a spaceship traveling through space.", max_length=200))
- Task
- Text Generation
- Library
- transformers
- Type
- RefinedWebModel
- Created
- Jun 18, 2023
- Updated
- Jul 9, 2023