Downloads · 30 days
229
6% of all-time downloads
RichardErkhov/piotr-ai_-_polanka-3b-pretrain-full-v0.4-gguf
piotr-ai_-_polanka-3b-pretrain-full-v0.4-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
229
6% of all-time downloads
All-time downloads
3.9K
Public
Repo size
45.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf52.6 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
polanka-3b-pretrain-full-v0.4 - GGUF
license: apache-2.0 language:
Full parameters pretrain checkpoint with Polish content from base model: openlm-research/open_llama_3b_v2
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
device = "cuda"
device_map = {
"lm_head": device,
"model": device
}
tokenizer = AutoTokenizer.from_pretrained("piotr-ai/polanka-3b-pretrain-full-v0.4")
model = AutoModelForCausalLM.from_pretrained("piotr-ai/polanka-3b-pretrain-full-v0.4", torch_dtype=torch.bfloat16, device_map=device_map)
prompt = "Psychologia to"
model_input = tokenizer(prompt, return_tensors="pt").to(device)
generated = model.generate(**model_input, do_sample=True, temperature=0.6, max_new_tokens=100)[0]
decoded = tokenizer.decode(generated, skip_special_tokens=False)
print(decoded)
<s> Psychologia to fascynująca dziedzina wiedzy, która wciąż kryje przed nami wiele tajemnic. Mechanizmy, które rządzą naszymi zachowaniami, decyzjami i wyborami, to nadal przedmiot badań wielu naukowców. Niektóre z nich ok