Downloads · 30 days
95
10% of all-time downloads
pravdin/merged-Gensyn-Qwen2.5-1.5B-Instruct-Qwen-Qwen2.5-1.5B-Instruct-gguf
merged-Gensyn-Qwen2.5-1.5B-Instruct-Qwen-Qwen2.5-1.5B-Instruct-gguf is a text generation model from pravdin. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
This is a collection of GGUF quantized versions of pravdin/merged-Gensyn-Qwen2.5-1.5B-Instruct-Qwen-Qwen2.5-1.5B-Instruct.
Downloads · 30 days
95
10% of all-time downloads
All-time downloads
939
Public
Repo size
4.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf3.8 GB · 100%
From the Hugging Face model README
This is a collection of GGUF quantized versions of pravdin/merged-Gensyn-Qwen2.5-1.5B-Instruct-Qwen-Qwen2.5-1.5B-Instruct.
This model was created by merging the following models:
pravdin/merged-Gensyn-Qwen2.5-1.5B-Instruct-Qwen-Qwen2.5-1.5B-Instruct
├── Merge Method: dare_ties
├── Gensyn/Qwen2.5-1.5B-Instruct
└── Qwen/Qwen2.5-1.5B-Instruct
├── density: 0.6
├── weight: 0.5
Merge Method: DARE_TIES - Advanced merging technique that reduces interference between models
This repository contains multiple quantization formats optimized for different use cases:
# Download a specific quantization
wget https://huggingface.co/pravdin/merged-Gensyn-Qwen2.5-1.5B-Instruct-Qwen-Qwen2.5-1.5B-Instruct/resolve/main/merged-Gensyn-Qwen2.5-1.5B-Instruct-Qwen-Qwen2.5-1.5B-Instruct.q4_k_m.gguf
# Run with llama.cpp
./main -m merged-Gensyn-Qwen2.5-1.5B-Instruct-Qwen-Qwen2.5-1.5B-Instruct.q4_k_m.gguf -p "Your prompt here"
from llama_cpp import Llama
# Load the model
llm = Llama(model_path="merged-Gensyn-Qwen2.5-1.5B-Instruct-Qwen-Qwen2.5-1.5B-Instruct.q4_k_m.gguf")
# Generate text
output = llm("Your prompt here", max_tokens=512)
print(output['choices'][0]['text'])
# Create a Modelfile
echo 'FROM ./merged-Gensyn-Qwen2.5-1.5B-Instruct-Qwen-Qwen2.5-1.5B-Instruct.q4_k_m.gguf' > Modelfile
# Create and run the model
ollama create merged-Gensyn-Qwen2.5-1.5B-Instruct-Qwen-Qwen2.5-1.5B-Instruct -f Modelfile
ollama run merged-Gensyn-Qwen2.5-1.5B-Instruct-Qwen-Qwen2.5-1.5B-Instruct "Your prompt here"
GGUF models are optimized for:
For best performance, ensure your hardware supports the quantization format you choose.
This model was automatically quantized using the Lemuru LLM toolkit.