Downloads · 30 days
6
3% of all-time downloads
turbcat-instruct-8b-int8-ct2
Anthonyg5005/turbcat-instruct-8b-int8-ct2
turbcat-instruct-8b-int8-ct2 is a text generation model from Anthonyg5005. Use it when you need the model to write or continue text. It is set up for CTranslate2. The card lists the license as llama3.
This is a int8float16 quantization of turbcat 8b\ See more on CTranslate2: Docs | Github
All-time downloads
211
Public
Repo size
8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- CTranslate2
- License
- llama3
- Access
- Public
- Created
- Jun 17, 2024
- Updated
- Mar 12, 2025
- SHA
- 5aa61d68
Try a prompt
Base models
Model card
From the Hugging Face model README
CTranslate2 int8 version of turbcat 8b
This is a int8_float16 quantization of turbcat 8b
See more on CTranslate2: Docs | Github
This model and it's dataset was created by Kaltcit, an admin of the Exllama Discord server.
This model was converted to ct2 format using the following commnd:
ct2-transformers-converter --model kat_turbcat --output_dir turbcat-ct2 --quantization int8_float16 --low_cpu_mem_usage
no converstion needed using the model from this repository as it is already in ct2 format.
- Task
- Text Generation
- Library
- CTranslate2
- License
- llama3
- Languages
- en
- Created
- Jun 17, 2024
- Updated
- Mar 12, 2025