Downloads · 30 days
0
gpt2-amharic-onnx-q8
bennysee/gpt2-amharic-onnx-q8
gpt2-amharic-onnx-q8 is a machine learning model from bennysee. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This is a quantized version of rasyosef/gpt2-small-amharic converted to ONNX with 8-bit quantization.
Access
Public
Updated Jun 6, 2026
Repo size
34.9 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.onnx34.9 MB · 96%
At a glance
- License
- mit
- Access
- Public
- Created
- Jun 6, 2026
- Updated
- Jun 6, 2026
- SHA
- 5c5e2e3f
Model card
From the Hugging Face model README
GPT-2 Amharic - Quantized ONNX (Q8)
This is a quantized version of rasyosef/gpt2-small-amharic converted to ONNX with 8-bit quantization.
Model Size
- Original PyTorch: ~550 MB
- FP32 ONNX: 130.83 MB
- Q8 ONNX: 34.74 MB (93.7 percent smaller)
Usage
import onnxruntime as ort
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained('bennysee/gpt2-amharic-onnx-q8')
session = ort.InferenceSession('bennysee/gpt2-amharic-onnx-q8/model_q8.onnx')
text = 'ሰላም'
inputs = tokenizer(text, return_tensors='np')
outputs = session.run(None, {'input_ids': inputs['input_ids']})
Files
- model_q8.onnx (33.24 MB) - Quantized model
- tokenizer.json - Tokenizer vocabulary
- tokenizer_config.json - Tokenizer config
- License
- mit
- Languages
- am
- Created
- Jun 6, 2026
- Updated
- Jun 6, 2026