Downloads · 30 days
154
6% of all-time downloads
RichardErkhov/Ba2han_-_Pretraining_Turkish-10k-step-gguf
Ba2han_-_Pretraining_Turkish-10k-step-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
154
6% of all-time downloads
All-time downloads
2.6K
Public
Repo size
4.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf5.6 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Pretraining_Turkish-10k-step - GGUF
license: mit language:
Pretrained on roughly 1.6B (mostly Turkish) tokens from HF and "high quality" scraped data using 1 RTX 3090. The training will continue. The model already can be (sort of) fine-tuned for instruction.
HF kaynaklı ve scrape edilen yaklaşık 1.6 Milyar (çoğunlukla Türkçe) token ile 1 RTX 3090 kullanılarak eğitilmiştir. Model şimdiden talimatlar için fine-tune edilebiliyor:

max_length=256, top_k=20, min_p=0.1, repetition_penalty=1.1, temperature=0.1, seed=22366 / TR_4k_LoRA