phi-2-int4

Tags

• safetensors
• phi
• custom_code
• arxiv:1910.09700
• text-generation-inference
• endpoints_compatible
• 4-bit
• bitsandbytes
• region:us