Downloads · 30 days
11
14% of all-time downloads
dots.llm1.inst-int4-w4a16
justinjja/dots.llm1.inst-int4-w4a16
dots.llm1.inst-int4-w4a16 is a machine learning model from justinjja. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
All-time downloads
79
Public
Parameters
144B
78.8 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors78.8 GB · 100%
Parameter types
How the weights are stored.
I32139B · 97%
Model card
From the Hugging Face model README
Testing - Don't download yet.
Inference:
Pip install git+https://github.com/redmoe-moutain/vllm.git
pip install git+https://github.com/redmoe-moutain/[email protected]
vllm serve justinjja/dots.llm1.inst-int4-w4a16 --max-model-len 8000
- Type
- dots1
- License
- mit
- Created
- Jun 6, 2025
- Updated
- Jun 6, 2025