Downloads · 30 days
61
8% of all-time downloads
VaibTFU/qwen-0.5b-stocks-news-v2-GGUF
qwen-0.5b-stocks-news-v2-GGUF is a machine learning model from VaibTFU. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF quantized versions of qwen-0.5b-stocks-news-v2.
Downloads · 30 days
61
8% of all-time downloads
All-time downloads
788
Public
Repo size
1.9 GB
Likes
1
Public
Click a slice to open those files.
.gguf1.9 GB · 100%
From the Hugging Face model README
GGUF quantized versions of qwen-0.5b-stocks-news-v2.
Fine-tuned Qwen2.5-0.5B-Instruct for financial news analysis. Outputs structured JSON with:
impactTerm: LONGTERM / SHORTTERMimpactScope: GLOBAL / INDUSTRY / STOCKscopeItems: list of affected stocks/industrieshighlights: key information summarysentiment: POSITIVE / NEGATIVE / NEUTRAL| Quantization | Size | Quality | Use Case |
|---|---|---|---|
| F16 | ~1 GB | Highest | Reference / GPU inference |
| Q8_0 | ~530 MB | Very High | Desktop / server inference |
| Q4_K_M | ~320 MB | Good | Mobile / edge / low-RAM |
./llama-cli -m qwen-0.5b-stocks-news-v2-q4_k_m.gguf \
-p '<|im_start|>system
You are a financial news AI. Analyze the given news article and output its scope, impact, highlights, and sentiment in JSON format. /no_think<|im_end|>
<|im_start|>user
RBI holds repo rate at 6.5% in MPC meeting<|im_end|>
<|im_start|>assistant
' \
-n 256 --temp 0.7
Create a Modelfile:
FROM ./qwen-0.5b-stocks-news-v2-q4_k_m.gguf
TEMPLATE """<|im_start|>system
{{ .System }}<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
"""
SYSTEM "You are a financial news AI. Analyze the given news article and output its scope, impact, highlights, and sentiment in JSON format. /no_think"
PARAMETER temperature 0.7
PARAMETER top_p 0.8
PARAMETER stop <|im_end|>
Then:
ollama create qwen-0.5b-stocks-news-v2 -f Modelfile
ollama run qwen-0.5b-stocks-news-v2 "Infosys Q3 profit rises 11%"