Downloads · 30 days
29
1% of all-time downloads
fr-boris-8bit
gustavecortal/fr-boris-8bit
fr-boris-8bit is a text generation model from gustavecortal. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This is a version of Cedille's GPT-J (fr-boris) with 6 billion parameters that is modified so you can generate and fine-tune the model in colab or equivalent desktop gpu (e.g. single 1080Ti). Inspired by GPT-J 8bit.
All-time downloads
3.5K
Public
Repo size
24.7 GB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.bin6.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- gptj
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Mar 4, 2022
- SHA
- 5a2bb943
Model card
From the Hugging Face model README
Quantized Cedille/fr-boris with 8-bit weights
This is a version of Cedille's GPT-J (fr-boris) with 6 billion parameters that is modified so you can generate and fine-tune the model in colab or equivalent desktop gpu (e.g. single 1080Ti). Inspired by GPT-J 8bit.
Here's how to run it:
This model can be easily loaded using the GPTJForCausalLM functionality:
from transformers import GPTJForCausalLM
model = GPTJForCausalLM.from_pretrained("gustavecortal/fr-boris-8bit")
fr-boris
Boris is a 6B parameter autoregressive language model based on the GPT-J architecture and trained using the mesh-transformer-jax codebase.
Boris was trained on around 78B tokens of French text from the C4 dataset.
Links
- Task
- Text Generation
- Library
- transformers
- Type
- gptj
- License
- mit
- Languages
- fr
- Created
- Mar 2, 2022
- Updated
- Mar 4, 2022