RedHatAI
SmolLM-360M-Instruct-quantized.w8a8
Based on HuggingFaceTB/SmolLM-360M-Instruct
Tags
- safetensors
- llama
- int8
- vllm
- conversational
- en
- arxiv:2210.17323
- base_model:HuggingFaceTB/SmolLM-360M-Instruct
- base_model:quantized:HuggingFaceTB/SmolLM-360M-Instruct
- license:apache-2.0
- text-generation-inference
- endpoints_compatible
Languages
en
- Author
- RedHatAI
- Task
- text-generation
- Library
- transformers
- Architecture
- llama
- License
- apache-2.0
- Base model
- HuggingFaceTB/SmolLM-360M-Instruct
- Downloads
- 106
- Likes
- 0