Downloads · 30 days
18
27% of all-time downloads
gpt2
inference4j/gpt2
gpt2 is a text generation model from inference4j. Use it when you need the model to write or continue text. It is set up for onnx. The card lists the license as mit.
ONNX export of GPT-2 (124M parameters) with KV cache support for efficient autoregressive generation.
All-time downloads
67
Public
Repo size
653 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.onnx653 MB · 100%
At a glance
- Task
- Text Generation
- Library
- onnx
- License
- mit
- Model type
- gpt2
- Access
- Public
- Created
- Feb 20, 2026
- Updated
- Feb 20, 2026
- SHA
- 48fa9592
Try a prompt
Model card
From the Hugging Face model README
GPT-2 — ONNX
ONNX export of GPT-2 (124M parameters) with KV cache support for efficient autoregressive generation.
Converted for use with inference4j, an inference-only AI library for Java.
Original Source
- Repository: OpenAI
- License: MIT
Usage with inference4j
try (Gpt2TextGenerator gen = Gpt2TextGenerator.builder().build()) {
GenerationResult result = gen.generate("Once upon a time");
System.out.println(result.text());
}
Model Details
| Property | Value |
|---|---|
| Architecture | GPT-2 (124M parameters, 12 layers, 768 hidden, 12 heads) |
| Task | Text generation |
| Context length | 1024 tokens |
| Vocabulary | 50257 tokens (BPE) |
| Original framework | PyTorch (transformers) |
| Export method | Hugging Face Optimum (with KV cache) |
License
This model is licensed under the MIT License. Original model by OpenAI.
- Task
- Text Generation
- Library
- onnx
- Type
- gpt2
- License
- mit
- Created
- Feb 20, 2026
- Updated
- Feb 20, 2026