gemma-3-12b-logql-finetune-0q

gemma-3-12b-logql-finetune-0q

Fine-tuned Gemma 3 12B for LogQL Query Generation [Standard HF]

This model is fine-tuned from Google's Gemma 3 12B to generate LogQL queries from natural language descriptions.

Model Information

• Base Model: google/gemma-3-12b-it

• Architecture: Gemma3

• Format: Standard Hugging Face / Transformers

• Use Case: LogQL query generation

Usage with Hugging Face Transformers

This model can be loaded directly using the transformers library.

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

model_name = "NiekWork/gemma-3-12b-logql-finetune-0q"

tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(
    model_name, 
    # Load in 8-bit mode if dynamically quantized
    load_in_8bit=False, 
    torch_dtype=torch.bfloat16 
)

prompt = "find the 5xx errors from the last 1 hour"
input_ids = tokenizer(prompt, return_tensors="pt").input_ids

# Generate text
output = model.generate(input_ids.to(model.device), max_new_tokens=100)
print(tokenizer.decode(output[0], skip_special_tokens=True))