Downloads · 30 days
16
5% of all-time downloads
falcon-40b-instruct-8bit
inarikami/falcon-40b-instruct-8bit
falcon-40b-instruct-8bit is a text generation model from inarikami. Use it when you need the model to write or continue text. It is set up for transformers.
This repository is home to the Falcon-40B-Instruct model, which has been carefully converted from its original 32-bit mode to an efficient and compact 8-bit file.
All-time downloads
319
Public
Repo size
41.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin41.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- RefinedWeb
- Access
- Public
- Created
- Jun 19, 2023
- Updated
- Jun 23, 2023
- SHA
- 325d4626
Try a prompt
Model card
From the Hugging Face model README
Falcon-40B-Instruct 8-bit Model
This repository is home to the Falcon-40B-Instruct model, which has been carefully converted from its original 32-bit mode to an efficient and compact 8-bit file.
Usage
You can use this model directly with a pipeline for tasks such as text generation and instruction following:
from transformers import pipeline
generator = pipeline('text-generation', model='tensorcat/falcon-40b-instruct-8bit')
print(generator("Generate a story about a spaceship traveling through space.", max_length=200))
- Task
- Text Generation
- Library
- transformers
- Type
- RefinedWeb
- Created
- Jun 19, 2023
- Updated
- Jun 23, 2023