Skip to content

EthanRhode

quantized-llama-4bit

Tags

  • safetensors
  • llama
  • conversational
  • arxiv:1910.09700
  • text-generation-inference
  • endpoints_compatible
  • 4-bit
  • gptq
  • region:us
Author
EthanRhode
Task
text-generation
Library
transformers
Architecture
llama
Downloads
5
Likes
0
quantized-llama-4bit — AI Model — AIMarketly