Downloads · 30 days
40
12% of all-time downloads
lateesha-bhatia/Llama-3.2-3B-SEC-Fintech-GGUF
Llama-3.2-3B-SEC-Fintech-GGUF is a text generation model from lateesha-bhatia. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as llama3.2.
A domain-adapted Small Language Model (SLM) optimized for high-precision information extraction from corporate SEC annual (10-K) and quarterly (10-Q) disclosures.
Downloads · 30 days
40
12% of all-time downloads
All-time downloads
339
Public
Repo size
2 GB
Likes
0
Public
Click a slice to open those files.
.gguf2 GB · 100%
From the Hugging Face model README
A domain-adapted Small Language Model (SLM) optimized for high-precision information extraction from corporate SEC annual (10-K) and quarterly (10-Q) disclosures.
Fine-tuned from meta-llama/Llama-3.2-3B-Instruct using QLoRA (Unsloth) and quantized to 4-bit q4_k_m GGUF format for zero-cost, low-latency CPU inference.
q4_k_m) via llama.cpp.llama-cpp-python, and LM Studio.SFTTrainer)q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_projunsloth.Q4_K_M.gguf from this repository.Modelfile in the same directory:FROM ./unsloth.Q4_K_M.gguf
TEMPLATE """<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|><|start_header_id|>user<|end_header_id|>
{{ .Prompt }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
{{ .Response }}<|eot_id|>"""
SYSTEM """You are a financial analyst. Extract structured facts from the following SEC context."""
PARAMETER stop "<|begin_of_text|>"
PARAMETER stop "<|start_header_id|>"
PARAMETER stop "<|end_header_id|>"
PARAMETER stop "<|eot_id|>"
PARAMETER temperature 0.1
PARAMETER top_p 0.9