Downloads · 30 days
98
6% of all-time downloads
Replit-v2-CodeInstruct-3B-ggml
abacaj/Replit-v2-CodeInstruct-3B-ggml
Replit-v2-CodeInstruct-3B-ggml is a text generation model from abacaj. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
All-time downloads
1.7K
Public
Repo size
1.5 GB
Likes
33
Public
Repo makeup
Click a slice to open those files.
.bin1.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- mpt
- Access
- Public
- Created
- Jun 27, 2023
- Updated
- Jun 29, 2023
- SHA
- f9c803a6
Try a prompt
Model card
From the Hugging Face model README
This is a ggml quantized version of Replit-v2-CodeInstruct-3B. Quantized to 4bit -> q4_1. To run inference you can use ggml directly or ctransformers.
- Memory usage of model: 2GB~
- Repo to run the model using ctransformers: https://github.com/abacaj/replit-3B-inference
- Task
- Text Generation
- Library
- transformers
- Type
- mpt
- License
- other
- Created
- Jun 27, 2023
- Updated
- Jun 29, 2023