mistral-7b-indian-university-guidance

Mistral 7B - Indian University Guidance for Bangladeshi Students

A fine-tuned Mistral-7B model specialized for providing comprehensive guidance to Bangladeshi students seeking admission to Indian universities. The model delivers accurate, domain-specific information about scholarships, admissions, visa processes, and degree equivalencies.

This model is trained on the contextual dataset introduced in our research paper: "Development of a Contextual Educational Dataset for Bangladeshi Students Studying in India" presented at Sharda University, Greater Noida, India.

Authors

• MD Millat Hosen
• Md Moudud Ahmed Misil
• Dr. Rohit Kumar Sachan

Model Highlights

• Excellent Perplexity: 1.4555 (indicating high prediction confidence)
• Domain-Specialized: Trained on 7,044 curated Q&A pairs
• Practical Knowledge: Covers Sharda University scholarships, degree equivalencies, GPA conversions, and regulatory requirements (AICTE, NMC, BMDC)
• Efficient Training: QLoRA fine-tuning on Tesla T4 (Google Colab Free Tier)

Model Description

This model is fine-tuned from mistralai/Mistral-7B-Instruct-v0.3 using the Unsloth framework with QLoRA (Quantized Low-Rank Adaptation). It provides specialized guidance covering:

Note: This model is primarily trained on Sharda University data and general degree equivalence information. It does not contain specific information about IITs, NITs, or other public universities.

Training Details

Configuration

Training Results

*Timer reset on Colab reconnections; this is cumulative GPU compute time only
**Actual elapsed time from first epoch start (07:32) to final epoch completion (10:58) was approximately 3 hours 26 minutes due to Colab session interruptions and reconnections

Training Progress

Hardware

Dataset

Trained on millat/indian_university_guidance_for_bangladeshi_students - a custom dataset containing 7,044 high-quality, instruction-formatted Q&A pairs created by the same authors using the SetForge pipeline.

Dataset Topics

Data Sources (from research paper)

⚠️ Note: This dataset does NOT include IITs, NITs, Central Universities, or other public/government institutions. It focuses exclusively on private universities in India's National Capital Region (NCR).

Data Fields

Each record in the dataset contains:

Data Statistics

Data Curation Pipeline

The dataset was created through the SetForge pipeline (as described in our research paper):

1. Source Selection: Identification of relevant sources from NCR private universities and government portals
2. Data Extraction: Content collected using WebScrape Chrome extension with support for dynamic content and PDF extraction via pdf.js
3. Data Preprocessing: NLP and RegEx-based cleaning, filtering, duplicate removal, and domain categorization
4. Data Categorization & Standardization: AI-powered document triage using LLMs for semantic chunking and schema-guided structuring with resilient error handling
5. Dataset Generation: Context-aware Q&A pair generation with instruction-based formatting using asyncio for concurrent processing, stored in JSONL format

Usage

With Unsloth (Recommended - Fastest)

from unsloth import FastLanguageModel

model, tokenizer = FastLanguageModel.from_pretrained(
    model_name="millat/mistral-7b-indian-university-guidance",
    max_seq_length=2048,
    load_in_4bit=True,
)
FastLanguageModel.for_inference(model)

prompt = """Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
What scholarships are available at Sharda University for Bangladeshi students?

### Response:
"""

inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
outputs = model.generate(**inputs, max_new_tokens=256, temperature=0.7)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

With Transformers

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

model_name = "millat/mistral-7b-indian-university-guidance"

tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(
    model_name,
    torch_dtype=torch.float16,
    device_map="auto",
)

prompt = """Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Can I get lateral entry to B.Tech 2nd year with my Polytechnic Diploma from Bangladesh?

### Response:
"""

inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(
    **inputs,
    max_new_tokens=256,
    do_sample=True,
    temperature=0.7,
    top_p=0.9,
)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

With GGUF (llama.cpp)

# Download the Q8_0 quantized version
huggingface-cli download millat/mistral-7b-indian-university-guidance \
    --include "*.gguf" \
    --local-dir ./models

# Run with llama.cpp
./main -m ./models/mistral-7b-indian-university-guidance-q8_0.gguf \
    -p "What are the requirements for MBBS admission in India for Bangladeshi students?" \
    -n 256

With Ollama

# Create Modelfile
cat << 'EOF' > Modelfile
FROM ./mistral-7b-indian-university-guidance-q8_0.gguf
TEMPLATE """Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{{ .Prompt }}

### Response:
"""
PARAMETER temperature 0.7
PARAMETER top_p 0.9
EOF

# Create and run
ollama create indian-uni-guide -f Modelfile
ollama run indian-uni-guide "What is the FRRO registration process?"

Example Outputs

Scholarship Information

Question: "I have a GPA of 3.8 out of 5.0 in my HSC from Bangladesh. What scholarship can I get at Sharda University?"

Response: "With a GPA of 3.8/5, you are eligible for a 50% tuition fee scholarship at Sharda University for programs like B.Tech, BBA, MBA, BCA, and others listed in the 50% scholarship category. This is because your GPA falls within the 3.5-5.0 range. Exclusions from scholarships include Pharmacy, M.Sc. Nursing, MPT, Medical M.Sc., BDS & MBBS. To retain this scholarship after first year, maintain 75% attendance and pass all exams without backlogs."

Degree Equivalency

Question: "I have a B.Sc. in Engineering from Bangladesh. Is it equivalent to B.Tech in India?"

Response: "Yes, your 4-year B.Sc. in engineering (Bangladeshi university curriculum) is considered equivalent to an Indian B.Tech or B.E. degree. The key requirement for recognition in Bangladesh is that the Indian engineering program must be AICTE-approved."

Medical Degree Recognition

Question: "Will my MBBS degree from India be recognized by BMDC in Bangladesh?"

Response: "For your MBBS or BDS degree from an Indian university to be recognized and valid for practice in Bangladesh, it must be NMC-approved (National Medical Commission) in India and subsequently recognized by the BMDC (Bangladesh Medical and Dental Council). Ensure that the program is full-time and on campus. Recognition typically requires completion of specific regulatory requirements by both parties."

Lateral Entry

Question: "Can I get lateral entry to B.Tech 2nd year with my Polytechnic Diploma from Bangladesh?"

Response: "Yes, your 4-year Polytechnic Diploma from Bangladesh (completed after SSC) makes you eligible for lateral entry into the second year of B.Tech programs at Indian universities like Sharda University. The Indian B.Tech degree is equivalent to B.Sc. in Engineering in Bangladesh. Ensure the Indian institution is AICTE-approved for your degree to be recognized back in Bangladesh."

FRRO Registration

Question: "What documents do I need for FRRO registration in India as a Bangladeshi student?"

Response: "You will need: original passport with visa, bonafide certificate from university/college, CPR certificate (compulsory pregnancy report if applicable), marriage certificate (if married), medical certificate (AIDS test result) and 4 photographs."

Model Comparison

The fine-tuned model shows significant improvements over the base model:

Available Formats

Limitations

• Geographic Scope: Focused on Bangladeshi students applying to Indian universities
• Temporal: Information reflects 2025 admission cycles; verify current requirements
• University Coverage:
  • Primary: Sharda University (most data - scholarships, programs, eligibility)
  • Secondary: Galgotias, Amity, Noida International University (NIU)
  • Not Covered: IITs (Indian Institutes of Technology), NITs (National Institutes of Technology), Central Universities, and other public/government universities
• Topic Bias: Heavy emphasis on scholarship eligibility criteria; limited information on campus life, placements, or research opportunities
• Not Legal Advice: For official processes, always verify with respective authorities

Ethical Considerations

• This model provides educational guidance and should not replace official university or government sources
• Users should verify scholarship amounts, eligibility criteria, and visa requirements with official sources
• The model may occasionally generate plausible but outdated information

Citation

If you use this model or dataset, please cite the research paper:

Paper Citation

@inproceedings{hosen2025contextual,
  author = {MD Millat Hosen and Md Moudud Ahmed Misil and Dr. Rohit Kumar Sachan},
  title = {Development of a Contextual Educational Dataset for Bangladeshi Students Studying in India},
  booktitle = {Proceedings of Sharda University},
  year = {2025},
  address = {Greater Noida, India},
  institution = {School of Computer Science and Engineering (SSCSE), Sharda University},
  keywords = {Bangladeshi, Large language model, Natural language processing, ChatBot, JSON}
}

Model Citation

@misc{hosen2025mistral_indian_uni,
  author = {MD Millat Hosen and Md Moudud Ahmed Misil and Dr. Rohit Kumar Sachan},
  title = {Mistral 7B - Indian University Guidance for Bangladeshi Students},
  year = {2025},
  publisher = {Hugging Face},
  url = {https://huggingface.co/millat/mistral-7b-indian-university-guidance},
  doi = {10.57967/hf/7639},
  note = {Fine-tuned with Unsloth + QLoRA on 7,044 domain-specific Q&A pairs}
}

Dataset Citation

@misc{hosen2025indian_university_dataset,
  author = {MD Millat Hosen and Md Moudud Ahmed Misil and Dr. Rohit Kumar Sachan},
  title = {indian_university_guidance_for_bangladeshi_students},
  year = {2025},
  url = {https://huggingface.co/datasets/millat/indian_university_guidance_for_bangladeshi_students},
  doi = {10.57967/hf/6295},
  publisher = {Hugging Face}
}

Acknowledgments

• Unsloth for efficient fine-tuning framework
• Mistral AI for the base model
• Hugging Face for model hosting and datasets infrastructure
• SetForge for the dataset generation pipeline
• WebScrape for data collection

License

Apache 2.0 - See LICENSE for details.

---

Model Card Last Updated: January 25, 2026