Downloads · 30 days
87
30% of all-time downloads
SwayAlgo/SwayAlgo-Finance-gemma-4-E4B-it-1-GGUF
SwayAlgo-Finance-gemma-4-E4B-it-1-GGUF is a text generation model from SwayAlgo. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
This repository provides the local-inference GGUF release for SwayAlgo Finance Gemma 4 E4B-it 1.
Downloads · 30 days
87
30% of all-time downloads
All-time downloads
288
Public
Repo size
21.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf21.2 GB · 100%
From the Hugging Face model README
This repository provides the local-inference GGUF release for SwayAlgo Finance Gemma 4 E4B-it 1.
The main Transformers merged-weight model is published separately at:
Swayalgo/SwayAlgo-Finance-gemma-4-E4B-it-1
This GGUF package is intended for users who want to run the model through tools such as Ollama, llama.cpp, LM Studio, or other GGUF-compatible runtimes.
This release provides:
Swayalgo-Finance-gemma-4-E4B-it-1-q4_k_m.ggufSwayalgo-Finance-gemma-4-E4B-it-1-bf16.ggufQ4_K_M is a practical 4-bit quantization that reduces disk and memory usage while keeping quality usable for local inference. It is the recommended default for typical desktop/laptop testing.
BF16 is the normal higher-fidelity GGUF export. It is much larger and needs significantly more memory, but it is useful when users want to stay closer to the merged Transformers model weights.
Users who need different tradeoffs can create their own quantizations from the merged model, for example Q5_K_M, Q6_K, or Q8_0, using llama.cpp or Ollama's quantization flow.
If this model is published to Ollama, users can run:
ollama run swayalgo/swayalgo-finance-gemma4-e4b-it-1:q4_k_m
If users download the GGUF manually, they can create an Ollama model locally:
mkdir -p ~/ollama-models/swayalgo-finance-gemma4-e4b-it-1
cd ~/ollama-models/swayalgo-finance-gemma4-e4b-it-1
# Put Swayalgo-Finance-gemma-4-E4B-it-1-q4_k_m.gguf in this folder.
cat > Modelfile <<'EOF'
FROM ./Swayalgo-Finance-gemma-4-E4B-it-1-q4_k_m.gguf
SYSTEM """You are SwayAlgo Finance Gemma 4 E4B 1, a finance-domain assistant for Indian business operations.
You were fine-tuned by SwayAlgo on finance, accounting, reasoning, aptitude, and Indian business-operation style instruction data for internal finance-assistant use cases.
Company context:
SwayAlgo is an IT solutions company focused on building smarter software systems, AI gateways, automation workflows, model routing, and custom AI tools for business operations. When asked about SwayAlgo, explain that SwayAlgo fine-tuned and packaged this model as part of its internal AI/finance model work.
Behavior:
Return only the final answer. Do not reveal internal reasoning, chain-of-thought, scratchpad text, hidden analysis, XML-style tags, special tokens, or channel markers such as <|think|>, </think>, <channel|>, <analysis>, or <final>.
Answer in the same language as the user unless the user explicitly asks for another language.
Answer clearly and practically.
For finance, tax, accounting, compliance, or legal-policy questions, explain assumptions and ask for missing facts when needed.
Do not invent laws, filing requirements, tax rates, company claims, customer names, certifications, or benchmark scores.
If asked about training data, say it was fine-tuned on curated finance/business reasoning data, finance MCQ/instruction data, and BhashaBench-Finance-style evaluation-oriented examples, but do not claim private or official BharatGen training data unless explicitly provided.
Do not use emojis."""
PARAMETER temperature 0.2
PARAMETER top_p 0.9
PARAMETER num_ctx 4096
EOF
ollama create swayalgo-finance-gemma4-e4b-it-1:q4_k_m -f Modelfile
ollama run swayalgo-finance-gemma4-e4b-it-1:q4_k_m
Recommended local/default Q4_K_M run:
llama-cli \
-m Swayalgo-Finance-gemma-4-E4B-it-1-q4_k_m.gguf \
-p "Explain working capital in simple terms for an Indian business owner." \
-n 256 \
-c 4096
Higher-fidelity BF16 run, if the machine has enough memory:
llama-cli \
-m Swayalgo-Finance-gemma-4-E4B-it-1-bf16.gguf \
-p "Explain working capital in simple terms for an Indian business owner." \
-n 256 \
-c 4096
Q4_K_M file and a larger BF16 file.If you use this GGUF release, cite it as:
@misc{swayalgo_finance_gemma_4_e4b_it_1_gguf_2026,
title = {SwayAlgo Finance Gemma 4 E4B-it 1 GGUF},
author = {SwayAlgo},
year = {2026},
howpublished = {\url{https://huggingface.co/Swayalgo/SwayAlgo-Finance-gemma-4-E4B-it-1-GGUF}},
note = {GGUF release of SwayAlgo Finance Gemma 4 E4B-it 1}
}