Llama3.2-3B-NPU-Turbo-NPU-mobile

Llama3.2-3B

Run Llama3.2-3B optimized for Qualcomm NPUs with nexaSDK.

Model Description

Llama3.2-3B is a 3-billion-parameter language model from Meta’s Llama 3.2 series.
It is designed to provide a balance of efficiency and capability, making it suitable for deployment on a wide range of devices while maintaining strong performance on core language understanding and generation tasks.

Trained on diverse, high-quality datasets, Llama3.2-3B supports multiple languages and is optimized for scalability, fine-tuning, and real-world applications.

Features

• Lightweight yet capable: delivers strong performance with a smaller memory footprint.
• Conversational AI: context-aware dialogue for assistants and agents.
• Content generation: text completion, summarization, code comments, and more.
• Reasoning & analysis: step-by-step problem solving and explanation.
• Multilingual: supports understanding and generation in multiple languages.
• Customizable: can be fine-tuned for domain-specific or enterprise use.

Use Cases

• Personal and enterprise chatbots
• On-device AI applications
• Document and report summarization
• Education and tutoring tools
• Specialized models in verticals (e.g., healthcare, finance, legal)

Inputs and Outputs

Input:

• Text prompts or conversation history (tokenized input sequences).

Output:

• Generated text: responses, explanations, or creative content.
• Optionally: raw logits/probabilities for advanced downstream tasks.

License

This model is released under the Creative Commons Attribution–NonCommercial 4.0 (CC BY-NC 4.0) license.
Non-commercial use, modification, and redistribution are permitted with attribution.
For commercial licensing, please contact [email protected].

References

• Meta AI – Llama Models
• Hugging Face Model Card