wantsleep

granite-3.1-1b-a400m-EAGLE3

wantsleep/granite-3.1-1b-a400m-EAGLE3

granite-3.1-1b-a400m-EAGLE3 is a machine learning model from wantsleep. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

granite 모델은 attention multiplier, embedding multiplier등 특별한 변수들이 있어서, eagle inference에도 그 변수들을 적용해주어야한다. 그래서 무조건 SafeAILab/EAGLE github이 아니라, "https://github.com/seohyunwoo-0407/EAGLEgranite" 레포지토리에서 코드를 실행해야한다.