nreimers

BERT-Small-L-4_H-512_A-8

nreimers/BERT-Small-L-4_H-512_A-8

BERT-Small-L-4_H-512_A-8 is a feature extraction model from nreimers. Use it when you need embeddings to search or compare text. It is set up for transformers.

This is a port of the BERT-Small model to Pytorch. It uses 4 layers, a hidden size of 512 and 8 attention heads.