quantize_push

Tags

• safetensors
• opt
• arxiv:1910.09700
• text-generation-inference
• endpoints_compatible
• 4-bit
• awq
• region:us