Downloads · 30 days
21
15% of all-time downloads
iblm
Ksgk-fy/iblm
iblm is a text generation model from Ksgk-fy. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
A custom GPT model trained on FineWeb 10B dataset.
All-time downloads
143
Public
Parameters
124M
1.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt1.1 GB · 70%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- custom_gpt
- Access
- Public
- Created
- Jan 5, 2026
- Updated
- Jan 5, 2026
- SHA
- 92b8caab
Try a prompt
Model card
From the Hugging Face model README
IBLM - GPT2-Small (FineWeb 10B)
A custom GPT model trained on FineWeb 10B dataset.
Model Details
- Architecture: Custom GPT with value residual connections and lambda mixing
- Parameters: ~124M (GPT2-small scale)
- Training Data: FineWeb 10B tokens
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
# Load model and tokenizer
model = AutoModelForCausalLM.from_pretrained(
"Ksgk-fy/iblm",
trust_remote_code=True
)
tokenizer = AutoTokenizer.from_pretrained("gpt2")
# Generate text
input_ids = tokenizer("Hello, world", return_tensors="pt").input_ids
with torch.no_grad():
outputs = model.generate(input_ids, max_new_tokens=50)
print(tokenizer.decode(outputs[0]))
Citation
If you use this model, please cite...
- Task
- Text Generation
- Library
- transformers
- Type
- custom_gpt
- License
- mit
- Created
- Jan 5, 2026
- Updated
- Jan 5, 2026