hamishivi

fixed-roberta-base

hamishivi/fixed-roberta-base

fixed-roberta-base is a feature extraction model from hamishivi. Use it when you need embeddings to search or compare text. It is set up for transformers.

roberta-base but with a resized embedding matrix and an extra dim in the token type embedding matrix for better sharding/partitioning.