Downloads · 30 days
0
gemma-2-9b-it-w4a16g128asym
numen-tech/gemma-2-9b-it-w4a16g128asym
gemma-2-9b-it-w4a16g128asym is a text generation model from numen-tech. Use it when you need the model to write or continue text. It is set up for mlc-llm. The card lists the license as gemma.
4-bit OmniQuant quantized version of gemma-2-9b-it.
Access
Public
Updated Oct 11, 2024
Repo size
4.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin4.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- mlc-llm
- License
- gemma
- Access
- Public
- Created
- Oct 11, 2024
- Updated
- Oct 11, 2024
- SHA
- 462f349f
Try a prompt
Base models
Model card
From the Hugging Face model README
4-bit OmniQuant quantized version of gemma-2-9b-it.
- Task
- Text Generation
- Library
- mlc-llm
- License
- gemma
- Created
- Oct 11, 2024
- Updated
- Oct 11, 2024