Downloads · 30 days
91
0% of all-time downloads
ruGPT-3.5-13B-GPTQ
fffrrt/ruGPT-3.5-13B-GPTQ
ruGPT-3.5-13B-GPTQ is a text generation model from fffrrt. Use it when you need the model to write or continue text. It is set up for transformers.
GPTQ quantisation of https://huggingface.co/ai-forever/ruGPT-3.5-13B
All-time downloads
26.8K
Public
Repo size
7.6 GB
Likes
26
Public
Repo makeup
Click a slice to open those files.
.safetensors7.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gpt2
- Access
- Public
- Created
- Jul 20, 2023
- Updated
- Jul 20, 2023
- SHA
- 45cc3de8
Try a prompt
Model card
From the Hugging Face model README
GPTQ quantisation of https://huggingface.co/ai-forever/ruGPT-3.5-13B
Small perplexity test: before quantization - 'mean_perplexity': 10.241 after quantization - 'mean_perplexity': 10.379
Data - RussianSuperGlue > DaNetQA/train.jsonl['passage']
As this is a hastily thrown together quant with no prior experience in quants, use https://huggingface.co/TheBloke version if he releases a quant for this model.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- Created
- Jul 20, 2023
- Updated
- Jul 20, 2023