compliance-analyzer-llama32-3b

Quality Management Compliance Analyzer LoRA — Llama 3.2 3B

This is a LoRA adapter fine-tuned on 100,000 synthetic instruction-style samples covering quality-management compliance analysis against ISO standards.

Completed by Aboutknowledge (Hong Kong) Limited — Alex Lee.

License note: the LoRA weights in this repository are released under the same terms as the base model, the Llama 3.2 Community License Agreement. Please review Meta's license before using or redistributing the merged weights.

Model details

Included files

• adapter_model.safetensors / adapter_config.json — standard PEFT LoRA adapter.
• compliance_analyzer.q8_0.gguf — Q8_0 GGUF file ready for Ollama.
• Modelfile — example Ollama Modelfile (edit the FROM path after downloading).

Use with transformers / Unsloth

from unsloth import FastLanguageModel

model, tokenizer = FastLanguageModel.from_pretrained(
    model_name="unsloth/Llama-3.2-3B-Instruct-bnb-4bit",
    max_seq_length=2048,
    dtype=None,
    load_in_4bit=True,
)
model = FastLanguageModel.get_peft_model(model, r=16, lora_alpha=16)
model.load_adapter("alexlkc28/compliance-analyzer-llama32-3b", adapter_name="default")

messages = [
    {"role": "system", "content": "You are an expert quality-management auditor and ISO standards consultant. Analyze the user's statement for compliance with relevant ISO/quality-management requirements. Provide a verdict (compliant, partially_compliant, or non_compliant), cite the relevant clause(s), explain your reasoning, and list actionable recommendations."},
    {"role": "user", "content": "We do not document management review meetings."},
]
inputs = tokenizer.apply_chat_template(messages, return_tensors="pt", tokenize=True).to("cuda")
outputs = model.generate(inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Use with Ollama

1. Download the GGUF and Modelfile from this repo.
2. Update the FROM line in the Modelfile to point to the downloaded GGUF path.
3. Create the model:

ollama create compliance-analyzer -f /path/to/Modelfile
ollama run compliance-analyzer

Training data

The data was generated synthetically from a compact ISO/quality-management knowledge base covering:

• ISO 9001, 14001, 45001, 27001, 13485, 50001
• IATF 16949 (automotive), AS9100D (aerospace)
• Compliance verdicts: compliant, partially_compliant, non_compliant
• Structured output: verdict, cited clause(s), explanation, recommendations

The full 100,000-record dataset is available locally in the project directory as data/compliance_100k_chat.jsonl.

Limitations

• Synthetic data can contain occasional grammar artifacts or mix standards in generic answers; always verify against the official standard text for compliance decisions.
• This is a 3B model; while useful for drafting and triage, it should not replace human auditors or regulatory review.