Downloads · 30 days
0
gemma-2-2b-it-q4f32_1-MLC
AMKCode/gemma-2-2b-it-q4f32_1-MLC
gemma-2-2b-it-q4f32_1-MLC is a text generation model from AMKCode. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as gemma.
This model was compiled using MLC-LLM with q4f321 quantization from google/gemma-2-2b-it. The conversion was done using the MLC-Weight-Conversion space.
Access
Public
Updated Oct 3, 2024
Repo size
1.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.5 GB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- gemma
- Access
- Public
- Created
- Oct 3, 2024
- Updated
- Oct 3, 2024
- SHA
- 8a3911be
Try a prompt
Base models
Model card
From the Hugging Face model README
AMKCode/gemma-2-2b-it-q4f32_1-MLC
This model was compiled using MLC-LLM with q4f32_1 quantization from google/gemma-2-2b-it. The conversion was done using the MLC-Weight-Conversion space.
To run this model, please first install MLC-LLM.
To chat with the model on your terminal:
mlc_llm chat HF://AMKCode/gemma-2-2b-it-q4f32_1-MLC
For more information on how to use MLC-LLM, please visit the MLC-LLM documentation.
- Task
- Text Generation
- Library
- transformers
- License
- gemma
- Created
- Oct 3, 2024
- Updated
- Oct 3, 2024