spam-classifier-mlx

Senior Project Notice

This repository was created for a senior project in ENGT 375 Applied Machine Learning at Old Dominion University. It is provided for educational and research demonstration purposes only. It is not intended for production use, security filtering, or making real-world spam/phishing decisions. Always use established security tools for operational email protection.

Spam Classifier — MLX LoRA Fine-Tune (Qwen 3.5 0.8B)

ENGT 375 — Applied Machine Learning | Spring 2026 | ODU A Qwen 3.5 0.8B language model fine-tuned with LoRA adapters on Apple Silicon using the MLX framework for spam email classification.

Model Details

• Base model: Qwen3.5-0.8B (4-bit quantized, OptiQ)
• Fine-tuning: LoRA (rank 8, scale 20.0, 1500 iterations)
• Framework: MLX (mlx-lm)
• Hardware: Apple Silicon (M-series)
• Task: Classify emails as spam or ham via chat-style prompts

Evaluation Results

Training Details

Hardware

• Device: Apple Silicon (M-series), 24GB unified memory
• Framework: MLX (Apple's machine learning framework optimized for Apple Silicon)

Dataset

• VoltageVagabond/spam-email-dataset

Usage

from mlx_lm import load, generate

model, tokenizer = load("models/Qwen3.5-0.8B-OptiQ-4bit", adapter_path="adapters")
prompt = "Classify this email as spam or ham:\n\nSubject: You won a prize!\n..."
response = generate(model, tokenizer, prompt=prompt, max_tokens=100)

Gradio Interface

pip install -r requirements.txt
python app.py

Files

• adapters/ — LoRA adapter weights (.safetensors)
• fine_tune.py — Training script
• app.py — Gradio web interface
• training_data/ — Training dataset (JSONL)

Intended Use

This model is an educational demonstration of LLM fine-tuning for text classification, created as part of a university course project. It is suitable for:

• Learning how LoRA fine-tuning works on Apple Silicon with MLX
• Understanding prompt-based classification with small language models
• Comparing LLM-based approaches to traditional ML classifiers

It is not intended for production spam filtering.

Limitations

• May misclassify legitimate marketing emails as spam
• Trained on English emails only — not suitable for other languages
• Small training set (2,204 train / 551 test examples) limits generalization
• 4-bit quantized base model trades some accuracy for memory efficiency

Related Models

Citation

@misc{voltagevagabond2026spammlx,
  title={Spam Classifier — MLX LoRA Fine-Tune (Qwen 3.5 0.8B)},
  author={VoltageVagabond},
  year={2026},
  howpublished={\url{https://huggingface.co/VoltageVagabond/spam-classifier-mlx}},
  note={ENGT 375 — Applied Machine Learning, Old Dominion University, Spring 2026}
}