Downloads · 30 days
23
2% of all-time downloads
mamba-tr-project-transformer
oguzatas/mamba-tr-project-transformer
mamba-tr-project-transformer is a text generation model from oguzatas. Use it when you need the model to write or continue text. The card lists the license as mit.
All-time downloads
969
Public
Parameters
110M
442 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors442 MB · 99%
At a glance
- Task
- Text Generation
- License
- mit
- Model type
- gpt2
- Access
- Public
- Created
- Dec 2, 2025
- Updated
- Apr 20, 2026
- SHA
- 484168e5
Model card
From the Hugging Face model README
Transformer Baseline (GPT-2 Style) - Turkish
This model serves as the baseline for a comparative study between Transformer and Mamba architectures on agglutinative languages (specifically Turkish). It is a decoder-only Transformer model (~111M parameters) trained on the Turkish Wikipedia dataset.
Model Description
- Architecture: GPT-2 (Small)
- Parameters: ~111 Million
- Context Length: 1024
- Training Data: Turkish Wikipedia (Nov 2023)
- Purpose: To provide a performance benchmark for the Mamba architecture.
Usage
from transformers import GPT2LMHeadModel, PreTrainedTokenizerFast
model_id = "oguzatas/mamba-tr-project-transformer"
tokenizer_id = "oguzatas/mamba-tr-project-tokenizer"
tokenizer = PreTrainedTokenizerFast.from_pretrained(tokenizer_id)
model = GPT2LMHeadModel.from_pretrained(model_id)
text = "Türkiye'nin başkenti"
inputs = tokenizer(text, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=20)
print(tokenizer.decode(outputs[0]))
- Task
- Text Generation
- Type
- gpt2
- License
- mit
- Languages
- tr
- Created
- Dec 2, 2025
- Updated
- Apr 20, 2026