Downloads · 30 days
41
8% of all-time downloads
phi-3-mini-4k-instruct-awq-4bit
elysiantech/phi-3-mini-4k-instruct-awq-4bit
phi-3-mini-4k-instruct-awq-4bit is a text generation model from elysiantech. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
[](https://colab.research.google.com/drive/1kFznlPlWYOrcgd7Q1NI2tYMLHvTRuys?usp=sharing)
All-time downloads
520
Public
Parameters
3.8B
2.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.3 GB · 100%
Parameter types
How the weights are stored.
I323.6B · 95%
Try a prompt
Model card
From the Hugging Face model README
phi-3-mini-4k-instruct-awq-4bit
phi-3-mini-4k-instruct-awq-4bit is a version of the Microsoft Phi 3 mini 4k Instruct model that was quantized using the AWQ method developed by Lin et al. (2023).
Please refer to the Original Phi 3 mini model card for details about the model preparation and training processes.
Dependencies
autoawq==0.2.5– AutoAWQ was used to quantize the phi-3 model.vllm==0.4.2– vLLM was used to host models for benchmarking.
- Task
- Text Generation
- Library
- transformers
- Type
- phi3
- License
- other
- Languages
- en
- Created
- Jul 5, 2024
- Updated
- Jul 6, 2024