Downloads · 30 days
96
4% of all-time downloads
ruGPT-3.5-13B-8bit
Gaivoronsky/ruGPT-3.5-13B-8bit
ruGPT-3.5-13B-8bit is a text generation model from Gaivoronsky. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This is a generative model converted to fp16 format based on ai-forever/ruGPT-3.5-13B
All-time downloads
2.5K
Public
Repo size
13.4 GB
Likes
16
Public
Repo makeup
Click a slice to open those files.
.bin13.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- gpt2
- Access
- Public
- Created
- Jul 21, 2023
- Updated
- Aug 23, 2023
- SHA
- 2183335c
Model card
From the Hugging Face model README
This is a generative model converted to fp16 format based on ai-forever/ruGPT-3.5-13B
Examples of usage
from transformers import AutoTokenizer
from auto_gptq import AutoGPTQForCausalLM
model = AutoGPTQForCausalLM.from_quantized('Gaivoronsky/ruGPT-3.5-13B-8bit', device="cuda:0", use_triton=False)
tokenizer = AutoTokenizer.from_pretrained('Gaivoronsky/ruGPT-3.5-13B-8bit')
request = "Человек: Сколько весит жираф? Помощник: "
encoded_input = tokenizer(request, return_tensors='pt', \
add_special_tokens=False).to('cuda')
output = model.generate(
**encoded_input,
num_beams=2,
do_sample=True,
max_new_tokens=100
)
print(tokenizer.decode(output[0], skip_special_tokens=True))
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- mit
- Languages
- ru, en
- Created
- Jul 21, 2023
- Updated
- Aug 23, 2023