Downloads · 30 days
20
9% of all-time downloads
d1g1mortal/Dolphin3.0-Qwen2.5-1.5B-ONNX
Dolphin3.0-Qwen2.5-1.5B-ONNX is a text generation model from d1g1mortal. Use it when you need the model to write or continue text. It is set up for transformers.js. The card lists the license as apache-2.0.
This repository contains the ONNX-exported weights for Dolphin 3.0 Qwen2.5 1.5B, specifically optimized for use with Transformers.js.
Downloads · 30 days
20
9% of all-time downloads
All-time downloads
217
Public
Repo size
1.8 GB
Likes
0
Public
Click a slice to open those files.
.onnx1.8 GB · 99%
From the Hugging Face model README
This repository contains the ONNX-exported weights for Dolphin 3.0 Qwen2.5 1.5B, specifically optimized for use with Transformers.js.
Dolphin 3.0 is an uncensored, steerable instruction-tuned model based on the Qwen 2.5 architecture. This version allows for private, high-performance inference directly in the browser or Node.js using WebGPU or WASM.
import { pipeline } from '@xenova/transformers';
const generator = await pipeline('text-generation', 'd1g1mortal/Dolphin3.0-Qwen2.5-1.5B-ONNX', {
device: 'webgpu',
});
const messages = [
{ role: "system", content: "You are Dolphin, a helpful AI assistant." },
{ role: "user", content: "Write a short creative poem about the ocean." },
];
const prompt = generator.tokenizer.apply_chat_template(messages, {
tokenize: false,
add_generation_prompt: true,
});
const output = await generator(prompt, {
max_new_tokens: 256,
temperature: 0.7,
do_sample: true,
});
console.log(output[0].generated_text);