ademyanchuk

tinyllama-quantized

ademyanchuk/tinyllama-quantized

tinyllama-quantized is a machine learning model from ademyanchuk. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.

Quantiazied tinyllama model (stories15m.pt). See original repo: https://github.com/karpathy/llama2.c See how to quantize here: https://github.com/ademyanchuk/llama2.c/blob/master/export.pyL282C14-L282C14 Use version 3…