akshathmangudi

llama3.1-8b-quantized

akshathmangudi/llama3.1-8b-quantized

llama3.1-8b-quantized is a text generation model from akshathmangudi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.1.

This is the quantized version of Llama3.1-8B using bitsandbytes. More quantized LLMs coming soon...