Downloads · 30 days
11
2% of all-time downloads
opt_metaseq_6700m
patrickvonplaten/opt_metaseq_6700m
opt_metaseq_6700m is a feature extraction model from patrickvonplaten. Use it when you need embeddings to search or compare text. It is set up for transformers.
All-time downloads
511
Public
Repo size
26.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt13.3 GB · 100%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- opt
- Access
- Public
- Created
- May 10, 2022
- Updated
- Jun 25, 2022
- SHA
- e9cd2997
Model card
From the Hugging Face model README
This repo let's you run the following checkpoint using facebookresearch/metaseq.
Do the following:
1. Install PyTorch
pip3 install torch==1.10.1+cu113 torchvision==0.11.2+cu113 torchaudio==0.10.1+cu113 -f https://download.pytorch.org/whl/cu113/torch_stable.html
2. Install Megatron
git clone https://github.com/patrickvonplaten/Megatron-LM.git
cd Megatron-LM
pip3 install six regex
pip3 install -e .
3. Install fairscale
git clone https://github.com/facebookresearch/fairscale.git
cd fairscale
git checkout prefetch_fsdp_params_simple
pip3 install -e .
4. Install metaseq
git clone https://github.com/patrickvonplaten/metaseq.git
cd metaseq
pip3 install -e .
5. Clone this repo (click top right on "How to clone")
6. Run the following:
cd <path/to/cloned/repo>
bash run.sh
- Task
- Feature Extraction
- Library
- transformers
- Type
- opt
- Created
- May 10, 2022
- Updated
- Jun 25, 2022