ChenMnZ

act_scales

ChenMnZ/act_scales

act_scales is a machine learning model from ChenMnZ. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

We provide the activation channel scales for OPT and BLOOM models. We get those scales with 512 random sentences in the Pile validation set. You can use ../examples/smoothquantoptdemo.ipynb to test smoothing and quant…