Downloads · 30 days
46
15% of all-time downloads
InduwaraR/qwen-ai-research-qa-q4_k_m.gguf
qwen-ai-research-qa-q4_k_m.gguf is a question answering model from InduwaraR. Use it when the input is a question plus a passage. The card lists the license as mit.
The Qwen AI Research QA Model is designed for answering research-oriented AI questions with a focus on precision and depth. This model is optimized in the Q4KM format for efficient inference while maintaining high-qua…
Downloads · 30 days
46
15% of all-time downloads
All-time downloads
301
Public
Repo size
1.9 GB
Likes
2
Public
Click a slice to open those files.
.gguf1.9 GB · 100%
From the Hugging Face model README
The Qwen AI Research QA Model is designed for answering research-oriented AI questions with a focus on precision and depth. This model is optimized in the Q4_K_M format for efficient inference while maintaining high-quality responses.
To use this model with llama-cpp-python, follow these steps:
Make sure you have llama-cpp-python installed:
pip install llama-cpp-python
from llama_cpp import Llama
llm = Llama.from_pretrained(
repo_id="InduwaraR/qwen-ai-research-qa-q4_k_m.gguf",
filename="qwen-ai-research-qa-q4_k_m.gguf",
)
response = llm.create_chat_completion(
messages=[
{"role": "user", "content": "What are the latest advancements in AI research?"}
]
)
print(response)
llama-cpp-pythonThis model is open-source and available under the MIT License.
This model is hosted by InduwaraR on Hugging Face. Special thanks to the Qwen AI team for their contributions to AI research and development.