Qwen3.8-27B-finance

Qwen3.8-27B-finance

Instruction-tuned finance assistant (macro, markets, trading, allocation).

This checkpoint specialises the base model on expert finance SFT cards: macro regimes, rates and credit, hedge-fund styles, and market structure. It is a research / briefing aid, not a regulated advisor.

What changed vs the reference

Reference = the published base checkpoint Qwen/Qwen3.8-27B, plus the first in-run loss (LoRA ≈ 0 at step 0).

The first logged train loss is the closest in-run proxy for the base model (LoRA starts near zero). Option F, when executed, adds an independent holdout comparison against the frozen merged base.

Training data

• File: finance_dataset_master.v2.jsonl
• Split: 0.05 holdout, seed 42
• Format: chat-templated SFT (messages / instruction+output / ### Instruction + ### Response)

Training procedure

Intended use

Market briefing, explaining factor and style risk, and structuring notes for an investment committee.

Out of scope: Not investment advice. Do not use it as the sole input for live trading or client recommendations.

Multimodal

Kept towers: vision, video. Vision/audio layers were frozen during text SFT (vision=False, audio=False). Load the merged Transformers folder (or GGUF + mmproj) to keep image / video / audio.

Sample (post-train smoke test)

Prompt: Summarize in 4 bullets how a rate hike typically hits equity multiples and credit spreads.

system
Reasoning effort is set to xhigh. Please think carefully through the task, validate key assumptions, consider plausible alternatives, and prioritize correctness, consistency, and clarity in the final answer.
user
Summarize in 4 bullets how a rate hike typically hits equity multiples and credit spreads.
assistant
<think>
We need answer concise 4 bullets. Need explain rate hike impact on equity multiples and credit spreads. Need likely: discount rates up, DCF multiples down, especially long-duration growth; earnings may lag, valuation compression. Credit: tighter financial conditions, higher funding costs, lower leverage capacity, higher spreads, especially high-yield and long-duration credit; but cyclical improvements can offset if hike is soft-landing. Need 4 bullets. Final only.
</think>

- Higher policy rates raise discount rates, which usually compress equity multiples, especially for long-duration growth and high-valuation stocks.
- Earnings may initially support prices, but if higher rates slow growth, multiple compression often dominates.
- Credit spreads tend to widen as borrowing costs rise, leverage capacity falls, and financial conditions tighten.
- High-yield and long-duration credit are typically more affected than investment-grade short-duration bonds.

How to use

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

repo = "nico248000000000/Qwen3.8-27B-finance"
tok = AutoTokenizer.from_pretrained(repo, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    repo, torch_dtype=torch.bfloat16, device_map="auto", trust_remote_code=True,
)
messages = [{"role": "user", "content": 'Summarize in 4 bullets how a rate hike typically hits equity multiples and credit spreads.'}]
inputs = tok.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
print(tok.decode(model.generate(inputs, max_new_tokens=256)[0], skip_special_tokens=True))

Limitations

• Domain shift: quality drops outside the SFT topics.
• Eval above is holdout loss (and optional targeted checks). It is not a public leaderboard.
• The base model license and acceptable-use policy still apply.

License

other — inherit and respect the license of Qwen/Qwen3.8-27B.