Downloads · 30 days
9
2% of all-time downloads
Sharjeelbaig/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-ONNX
MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-ONNX is a text generation model from Sharjeelbaig. Use it when you need the model to write or continue text. It is set up for optimum.
This repository contains an ONNX Runtime export generated with Optimum from the matching Transformers checkpoint:
Downloads · 30 days
9
2% of all-time downloads
All-time downloads
409
Public
Repo size
4.3 GB
Likes
0
Public
Click a slice to open those files.
.onnx_data4.3 GB · 100%
From the Hugging Face model README
This repository contains an ONNX Runtime export generated with Optimum from the matching Transformers checkpoint:
GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking
The requested source checkpoint mlx-community/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-OptiQ-4bit is an MLX-native mixed-precision artifact. Optimum cannot load that MLX quantization format directly, so this export uses the matching full-precision Transformers checkpoint and is stored as FP32 ONNX with external data.
from optimum.onnxruntime import ORTModelForCausalLM
from transformers import AutoTokenizer
model_id = "Sharjeelbaig/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-ONNX"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = ORTModelForCausalLM.from_pretrained(model_id)
The model was exported with the text-generation-with-past task and validated by ONNX Runtime on CPU.