Downloads · 30 days
0
AGofficial/AgGPT-8.8
AgGPT-8.8 is a machine learning model from AGofficial. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
AgGPT88 is a rewritten n-gram text generator designed from the ground up to handle corpora 1000x larger than traditional models by avoiding in-memory n-gram frequency tables. Instead, it stores a tokenized corpus and…
Downloads · 30 days
0
Access
Public
Updated Jun 5, 2025
Repo size
15.5 MB
Likes
1
Public
Click a slice to open those files.
.js15.5 MB · 100%
From the Hugging Face model README
AgGPT8_8 is a rewritten n-gram text generator designed from the ground up to handle corpora 1000x larger than traditional models by avoiding in-memory n-gram frequency tables. Instead, it stores a tokenized corpus and dynamically scans it at prediction time to find next-word candidates, greatly reducing memory usage while trading off prediction speed.
This architecture allows working with massive datasets without crashing or excessive RAM consumption, making it ideal for very large corpora. However, generation is slower due to on-the-fly scanning. Future improvements can add indexing or partial precomputation to boost speed while retaining scalability.