gemma3-270m-it-adp-trained

gemma3-270m-it-adp-trained

🧠 Overview

gemma3-270m-it-adp-trained is a full fine-tuned version of Gemma 270M, optimized for deterministic structured JSON generation from natural language prompts. It was trained to handle schema constraints, ambiguous field mappings, and edge-case logic traps with high fidelity — ideal for strategic planning, governance, and AI-powered decision support systems.

🏗️ Training Configuration

• Platform: Kaggle (GPU T4 ×2)
• Framework: Hugging Face Transformers
• Epochs: 10
• Batch Size: 4 (per device)
• Gradient Accumulation: 1
• Learning Rate: 3e-5
• Warmup Steps: 100
• Weight Decay: 0.01
• Mixed Precision: Disabled (fp16=False)
• Logging & Checkpoints: Disabled
• Seed: 42

⏱️ Training & Evaluation Time

• Training Time: 17 minutes 49 seconds (Epoch 10/10)
• Test Time: 25 minutes for 50 tests (~100 calls)

📉 Step-wise Loss Progression

📦 Dataset

450 Training and 50 Evaluation examples. vakodiya/adp-custom-oriented Custom synthetic benchmark designed to:

• Stress-test schema adherence
• Resolve ambiguous field mappings
• Expose edge-case logic traps
• Validate output determinism under constrained prompts

🔍 Intended Use

• Natural language → structured JSON conversion
• Schema-constrained generation tasks
• Strategic modeling in energy, education, health, and infrastructure
• Ethical AI systems requiring deterministic, interpretable outputs

⚠️ Limitations

• Not optimized for open-ended or conversational tasks
• Requires schema-aware prompting for best results
• May underperform on tasks requiring creative or unconstrained generation

🧪 Evaluation Metrics

🌐 Ethical Considerations

This model was trained with a focus on voluntary harmony, transparent logic, and moral engineering. It is intended for use in systems that empower users, protect virtue, and deter vice — without coercion. It should not be deployed in opaque or manipulative environments.

🚀 Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("vakodiya/gemma3-270m-it-adp-trained")
tokenizer = AutoTokenizer.from_pretrained("vakodiya/gemma3-270m-it-adp-trained")

Sample Data for train

  {
    "Instruction": "Show Compliance documents for 6003 from Finance dated this year.",
    "Response": {
      "Type": "",
      "Note": "",
      "Company": "Finance",
      "Entity": "6003",
      "Doc. Type": "",
      "Subject": "Compliance",
      "Date": "",
      "Crea Date & Time": [
        "2023-01-01T00:00:00",
        "2023-12-31T23:59:59"
      ],
      "Modified Date & Time": "",
      "Pages": "",
      "Size": "",
      "ambiguous_message": ""
    }
  }

Sample Evaluation

  {
    "instruction": "Show documents related to Sara Khan in Legal modified modified in July.",
    "expected": "Type: ; Note: ; Company: Legal; Entity: Sara Khan; Doc. Type: ; Subject: ; Date: ; Crea Date & Time: ; Modified Date & Time: [\"2025-07-01T00:00:00\", \"2025-07-31T23:59:59\"]; Pages: ; Size: ; ambiguous_message: ",
    "trained_model_output": "Show documents related to Sara Khan in Legal modified modified in July. Type: ; Note: ; Company: Legal; Entity: Sara Khan; Doc. Type: ; Subject: ; Date: ; Crea Date & Time: ; Modified Date & Time: [\"2025-07-01T00:00:00\", \"2025-07-31T23:59:59\"]; Pages: ; Size: ; ambiguous_message: 4\n\nType: ; Note: ; Company: Legal; Entity: Sara Khan; Doc. Type: ; Subject: ; Date: ; Crea Date & Time: ; Modified Date & Time: [\"2025-07-01T00:00:00\", \"2025-08-31T23:59:59\"]; Pages: ; Size: ; ambiguous_message: 60\n\nType: ; Note: ; Company: Legal; Entity: Sara Khan; Doc. Type: ; Subject: ; Date: ; Crea Date & Time: ; Modified Date & Time: [\"2025-07-01T00:00:00\", \"2025-08-31T2",
    "original_model_output": "Show documents related to Sara Khan in Legal modified modified in July.\nShe is a prominent and respected figure in the legal field, known for her expertise in litigation, business, and personal finance.\nHer work has been recognized with many awards and accolades.\nSara Khan is a highly skilled attorney and a respected expert in the legal field.\nShe is known for her strong negotiation skills and ability to develop strong client relationships.\nShe has been involved in various cases in high-profile legal cases.\nShe is a skilled negotiator and negotiator, and has the ability to handle sensitive and complex situations.\nShe is also a highly effective communicator with strong verbal and written communication skills.\nShe has been involved in various legal matters and has been a respected and trusted expert in the legal field.\nShe is a skilled negotiator and negotiator, and has the ability to handle sensitive and complex situations.\nShe is also a highly effective communicator with strong verbal and written communication skills.\nShe has been involved in various legal matters and has been a respected and trusted expert in the legal field.\nShe is a skilled negotiator and negotiator, and has the ability to handle sensitive and complex situations.\nShe is also a highly effective communicator with strong verbal and written communication skills.\nShe has been involved in various legal matters and has been a respected and trusted expert"
  }