Downloads Β· 30 days
34
11% of all-time downloads
itcen-entec/gemma-3-4b-tax-law-lora-gguf
gemma-3-4b-tax-law-lora-gguf is a text generation model from itcen-entec. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
π°π· Korean tax-law Q/A specialized LoRA fine-tuned model based on Gemma 3 4B, converted to GGUF format for efficient inference.
Downloads Β· 30 days
34
11% of all-time downloads
All-time downloads
320
Public
Repo size
4.8 GB
Likes
0
Public
Click a slice to open those files.
.gguf4.8 GB Β· 100%
From the Hugging Face model README
π°π· Korean tax-law Q/A specialized LoRA fine-tuned model based on Gemma 3 4B, converted to GGUF format for efficient inference.
# Download the model
ollama pull hongjoong-entec/gemma-3-4b-tax-law-lora-gguf
# Or use locally if you have the GGUF file
ollama create gemma3-tax-law -f Modelfile
# Run the model
ollama run gemma3-tax-law "μ λλΉ νλλ μ΄λ»κ² κ³μ°νλμ?"
# Download the GGUF file
wget https://huggingface.co/hongjoong-entec/gemma-3-4b-tax-law-lora-gguf/resolve/main/gemma-3-4b-tax-law-lora.gguf
# Run with llama.cpp
./main -m gemma-3-4b-tax-law-lora.gguf -p "μ λλΉ νλλ μ΄λ»κ² κ³μ°νλμ?" -n 256
from llama_cpp import Llama
# Load the GGUF model
llm = Llama(
model_path="./gemma-3-4b-tax-law-lora.gguf",
n_ctx=2048,
n_threads=8,
)
# Prompt template for best results
prompt_style = """Below is an instruction that describes a task, paired with an input that provides further context.
Write a response that appropriately completes the request.
Respond in Korean and provide only the final answer without chain-of-thought, analysis, section headers, or disclaimers.
If needed, include a brief basis in one concise sentence.
### Question:
{}
### Response:
{}"""
# Example usage
question = "μ λλΉ νλλ μ΄λ»κ² κ³μ°νλμ?"
prompt = prompt_style.format(question, "")
# Generate response
output = llm(
prompt,
max_tokens=1024,
temperature=0.01,
top_p=0.95,
stop=["###", "Question:", "Response:"],
echo=False
)
print(output['choices'][0]['text'].strip())
This repository contains the following files:
gemma-3-4b-tax-law-lora.gguf: The quantized GGUF model fileModelfile: Ollama configuration fileβ οΈ Important Disclaimers:
The GGUF model demonstrates good performance on Korean tax-related queries while offering:
Use this model as a starting point for research rather than definitive answers.