KrishokChat-Advisory-System

KrishokChat: Agricultural Advisory & Disease Detection Model Suite

KrishokChat is an end-to-end provenance-traceable multi-task Bengali agricultural advisory and crop disease diagnosis system designed for Bangladeshi farming ecosystems.

This repository contains the complete suite of models, fine-tuned weights, knowledge indexes, and advisory maps used by the KrishokChat application.

---

📂 Repository Structure

RaiyanKhaan/KrishokChat-Advisory-System/
├── README.md                                  # Main Model Card & Usage Guide
├── vision/                                    # Ultralytics YOLO Crop & Disease Vision Models
│   ├── crop_classifier/
│   │   ├── model.pt                           # 9-Crop Root Classifier (11.96 MB)
│   │   └── class_names.json                   # Crop class mapping
│   ├── brassica_disease/
│   │   ├── model.pt                           # Brassica Disease Classifier (10.54 MB)
│   │   ├── class_names.json                   # Disease labels (Alternaria, Black Rot, Downy Mildew, etc.)
│   │   └── disease_details.json               # Symptoms & remedy metadata
│   ├── corn_disease/
│   │   ├── model.pt                           # Corn / Maize Disease Classifier (10.52 MB)
│   │   ├── class_names.json                   # Labels (Common Rust, Gray Leaf Spot, Northern Leaf Blight, Healthy)
│   │   └── disease_details.json
│   ├── potato_disease/
│   │   ├── model.pt                           # Potato Disease Classifier (10.52 MB)
│   │   ├── class_names.json                   # Labels (Early Blight, Late Blight, Healthy)
│   │   └── disease_details.json
│   ├── rice_disease/
│   │   ├── model.pt                           # Rice Disease Classifier (3.06 MB)
│   │   ├── class_names.json                   # Labels (Bacterial Blight, Brown Spot, Blast, Rice Hispa, Sheath Blight)
│   │   └── disease_details.json
│   ├── wheat_disease/
│   │   ├── model.pt                           # Wheat Disease Classifier (9.00 MB)
│   │   ├── class_names.json                   # Labels (Wheat Blast, Leaf Rust, Stem Rust, Stripe Rust, etc.)
│   │   ├── disease_details.json
│   │   └── metadata.json
│   ├── verification_report.json               # Benchmark accuracies & test validation outputs
│   └── verification_report_live.md
├── gemma_llm/                                 # Bengali Agricultural Domain Language Models
│   ├── krishokchat.f16.gguf                   # 16-bit GGUF model for fast CPU/GPU inference via llama.cpp/Ollama (1.29 GB)
│   └── checkpoint-4020/                       # Stage-1 SFT Fine-Tuned LoRA Adapter Weights & Tokenizer
│       ├── adapter_model.safetensors          # LoRA weights (266.2 MB)
│       ├── adapter_config.json                # LoRA hyperparameter configuration
│       ├── tokenizer.json                     # Bengali-extended SentencePiece tokenizer (30.68 MB)
│       ├── tokenizer_config.json
│       ├── processor_config.json
│       ├── chat_template.jinja                # Jinja2 chat template for conversation turns
│       ├── trainer_state.json                 # Training history & loss curves
│       └── training_args.bin
├── rag_knowledge_index/                       # Hybrid Dense (FAISS) + Sparse (BM25) Knowledge System
│   ├── indexes/
│   │   ├── nodes.faiss                        # FAISS FlatIP index (BGE-M3 1024-dim dense embeddings) (8.34 MB)
│   │   ├── embeddings.npy                     # Dense embedding matrix
│   │   ├── bm25_index.pkl                     # Sparse BM25 Okapi retrieval index (16.23 MB)
│   │   ├── bm25_corpus_tok.pkl                # Tokenized BM25 corpus (4.47 MB)
│   │   ├── node_ids.json                      # Node identifier lookup table
│   │   ├── term_map.json                      # Domain taxonomy, pesticide brand mapping & disease synonyms
│   │   └── phase4_dialect_map.json            # 6-Region Dialect normalization map (Barisal, Chittagong, Sylhet, etc.)
│   ├── processed/
│   │   ├── knowledge_nodes_clean.jsonl        # 2,135 Clean Knowledge Nodes (BARC, BARI, BRRI, CABI, DAE) (11.99 MB)
│   │   └── knowledge_nodes_refined.jsonl      # Refined multi-turn grounded knowledge nodes (9.95 MB)
│   ├── eval/
│   │   ├── farmer_benchmark_1000.jsonl        # 1,000 real-world Bengali farmer benchmark queries
│   │   ├── coverage_gaps_v1.json              # Coverage gap audit report
│   │   └── dialect_map_derivation_audit_v1.json
│   ├── provenance/
│   │   ├── manifest_md_to_qa.json             # Literature-to-QA audit trail (9.98 MB)
│   │   └── manifest_node_to_qa.json           # Node-to-QA audit trail (2.78 MB)
│   ├── manifest.json                          # Build manifest with version hashes
│   └── README.md
└── advisory_engine/                           # Structured Advisory Mapping
    ├── disease_knowledge_map.json             # Disease-to-remedy & dosage structured dictionary
    ├── generated_knowledge_nodes.jsonl        # Multi-step expert verified advisory nodes
    ├── generation_tasks.json                  # Advisory evaluation tasks
    └── test_cases.md                          # Clinical test cases & expected responses

---

🌿 1. Vision Models (Crop & Disease Detection)

The vision pipeline implements a two-stage hierarchical classifier using Ultralytics YOLO:

1. Stage 1 (Root Crop Classifier): Identifies the crop species (Brassica, Corn, Potato, Rice, Wheat, Solanacea, etc.).
2. Stage 2 (Disease Specialist): Routes the image to the dedicated crop disease classifier to determine the specific pathogen / health state.

Classes Supported:

• Rice Diseases: Bacterial Leaf Blight, Brown Spot, Healthy Leaf, Leaf Blast, Leaf Scald, Narrow Brown Leaf Spot, Rice Hispa, Sheath Blight.
• Wheat Diseases: Wheat Blast, Black Point, Fusarium Foot Rot, Leaf Rust, Leaf Blight, Powdery Mildew, Stem Rust, Stripe Rust, Healthy.
• Potato Diseases: Early Blight, Late Blight, Healthy Leaf.
• Corn Diseases: Common Rust, Gray Leaf Spot, Northern Leaf Blight, Healthy.
• Brassica Diseases: Cabbage Alternaria Spot, Cabbage Black Rot, Cabbage Downy Mildew, Cauliflower Downy Mildew, Cauliflower Bacterial Soft Rot, Cauliflower Black Spot, Healthy.

Usage Example:

from ultralytics import YOLO
from PIL import Image

# 1. Classify Crop
crop_model = YOLO("vision/crop_classifier/model.pt")
crop_result = crop_model("leaf.jpg")[0]
predicted_crop = crop_model.names[crop_result.probs.top1]
print(f"Detected Crop: {predicted_crop}")

# 2. Classify Disease (e.g., Rice)
if predicted_crop.lower() == "rice":
    disease_model = YOLO("vision/rice_disease/model.pt")
    disease_result = disease_model("leaf.jpg")[0]
    predicted_disease = disease_model.names[disease_result.probs.top1]
    print(f"Diagnosis: {predicted_disease}")

---

🤖 2. Language Models (Gemma Bengali Agriculture LLM)

• Base Model: Google Gemma 4B Instruction-Tuned
• Fine-Tuning: LoRA Stage 1 Supervised Fine-Tuning (SFT) on verified Bengali agricultural Q&A datasets.
• GGUF Quantization: 16-bit GGUF model optimized for CPU/GPU edge deployment.

Usage with Hugging Face Transformers & PEFT:

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
import torch

base_model_id = "google/gemma-2-2b-it" # or 4B base
tokenizer = AutoTokenizer.from_pretrained("gemma_llm/checkpoint-4020")
base_model = AutoModelForCausalLM.from_pretrained(
    base_model_id,
    torch_dtype=torch.float16,
    device_map="auto"
)
model = PeftModel.from_pretrained(base_model, "gemma_llm/checkpoint-4020")

prompt = "<start_of_turn>user\nধানের ব্লাস্ট রোগের লক্ষণ ও প্রতিকার কী?<end_of_turn>\n<start_of_turn>model\n"
inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
outputs = model.generate(**inputs, max_new_tokens=300, temperature=0.2)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Usage with llama-cpp (GGUF):

from llama_cpp import Llama

llm = Llama(
    model_path="gemma_llm/krishokchat.f16.gguf",
    n_ctx=2048,
    n_threads=6
)
output = llm(
    "<start_of_turn>user\nআলুর লেট ব্লাইট কীভাবে প্রতিরোধ করব?<end_of_turn>\n<start_of_turn>model\n",
    max_tokens=256,
    temperature=0.2
)
print(output["choices"][0]["text"])

---

📚 3. Hybrid RAG Knowledge & Retrieval System

The RAG index combines dense semantic search and sparse lexical matching:

• Dense Index: FAISS FlatIP index with 1024-dimensional BAAI/bge-m3 multilingual embeddings across 2,135 curated agricultural knowledge nodes.
• Sparse Index: BM25 Okapi index tokenized for Bengali domain vocabulary.
• Dialect Normalization: 6 Regional Bangladeshi dialects (Rajshahi, Sylhet, Chittagong, Barisal, Rangpur, Noakhali) mapped to standard terms.
• Sources: Bangladesh Agricultural Research Council (BARC FRG 2024), BARI, BRRI, CABI, DAE, DLS, DoF.

Usage Example:

import faiss
import numpy as np
import pickle
import json

# 1. Load FAISS index and metadata
index = faiss.read_index("rag_knowledge_index/indexes/nodes.faiss")
with open("rag_knowledge_index/indexes/node_ids.json", "r", encoding="utf-8") as f:
    node_ids = json.load(f)

# 2. Load BM25 index
with open("rag_knowledge_index/indexes/bm25_index.pkl", "rb") as f:
    bm25 = pickle.load(f)

print(f"FAISS index loaded with {index.ntotal} vectors.")

---

🔗 Integration with Frontend (suggested-questions.tsx)

In KrishokChat's user interface, suggested-questions.tsx connects directly to this model suite:

• Vision outputs (predicted_crop, predicted_disease) are mapped via CROP_LABELS and DISEASE_LABELS to dynamically generate targeted Bengali advisory prompts.
• DialectSelector triggers regional dialect queries normalized by phase4_dialect_map.json into the hybrid RAG retrieval pipeline.

---

📄 License & Attribution

• License: MIT License
• Developed by: Raiyan Reza (RaiyanKhaan)
• Project: KrishokChat - A Provenance-Traceable Multi-Task Bengali Agricultural Advisory System