Downloads · 30 days
84
0% of all-time downloads
NobodyExistsOnTheInternet/Llama-2-70b-x8-MoE-clown-truck
Llama-2-70b-x8-MoE-clown-truck is a text generation model from NobodyExistsOnTheInternet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Downloads · 30 days
84
0% of all-time downloads
All-time downloads
26.8K
Public
Parameters
464B
927 GB on disk
Likes
8
Public
Click a slice to open those files.
.safetensors927 GB · 100%
From the Hugging Face model README

The biggest model ever to have been released. Has not been tested, nor do I have the compute to test it. If anyone is willing to host this to help me test, please share your results in the community tab.
Thank you for coming to my ted talk.
This is nearly 960GB of weights. It requires at least 8xA100 80gb to run it in 4 bits probably. probably