hunoutl

bloomchat-deepspeed-inference-fp16

hunoutl/bloomchat-deepspeed-inference-fp16

bloomchat-deepspeed-inference-fp16 is a feature extraction model from hunoutl. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as other.

This is a copy of the original 🌸 BLOOMChat weights that is more efficient to use with the DeepSpeed-Inference 🚀. In this repo the original tensors are split into 8 shards to target 8 GPUs, this allows the user to ru…