Downloads · 30 days
0
vincentoh/redPJs-1.58Bit-1B
redPJs-1.58Bit-1B is a machine learning model from vincentoh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
RedPJs-B1.58-1B is a 1B parameter model trained using the method described in The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits.
Downloads · 30 days
0
Access
Public
Updated May 6, 2024
Repo size
—
Likes
0
Public
Click a slice to open those files.
Other1.5 KB · 83%
From the Hugging Face model README
RedPJs-B1.58-1B is a 1B parameter model trained using the method described in The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits.
It was trained on 1T tokens of the Red Pajamas dataset, so it is merely a research proof-of-concept to test out the methodolgy.