patrykloan

talkie-web-13b-base

patrykloan/talkie-web-13b-base

talkie-web-13b-base is a machine learning model from patrykloan. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

talkie-web-13b-base is a 13B language model trained on 260B tokens of FineWeb. It is identical architecturally to talkie-1930-13b-base and exists to make possible controlled comparisons between vintage and modern LMs.