Skip to content

Rohan-G

bnb_4_bit_quantization

Tags

  • safetensors
  • llama
  • arxiv:1910.09700
  • text-generation-inference
  • endpoints_compatible
  • 4-bit
  • bitsandbytes
  • region:us
Author
Rohan-G
Task
text-generation
Library
transformers
Architecture
llama
Downloads
9
Likes
0
bnb_4_bit_quantization — AI Model — AIMarketly