Skip to content

codepipe

quantized-llama3.1-8B-Instruct-4bit

Tags

  • safetensors
  • llama
  • arxiv:1910.09700
  • text-generation-inference
  • endpoints_compatible
  • 4-bit
  • bitsandbytes
  • region:us
Author
codepipe
Task
text-generation
Library
transformers
Architecture
llama
Downloads
5
Likes
0
quantized-llama3.1-8B-Instruct-4bit — AI Model — AIMarketly