CVE-Analyst-Ministral-3B-Adapters-Merged

CVE Analyst -- Ministral-3-3B (Merged)

Fine-tuned mistralai/Ministral-3-3B-Instruct-2512-BF16 on the AlicanKiraz0/All-CVE-Records-Training-Dataset dataset using QLoRA, then merged into a standalone BF16 model.

This is the merged version with LoRA adapter weights baked into the base model. No adapter loading needed -- use it like any standard model. For the lightweight adapter-only version, see noman-asif/CVE-Analyst-Ministral-3B-QLoRA.

Model Description

This model is specialised for CVE vulnerability analysis -- given a vulnerability identifier and context, it produces structured technical analyses including exploitation vectors, impact assessment, and remediation strategies.

Training Data

Dataset: AlicanKiraz0/All-CVE-Records-Training-Dataset

Attribution: Dataset created by AlicanKiraz0.

License: Apache 2.0

Sample size: 10000 rows (filtered to fit within 4096 tokens).

Training Procedure

• Hardware: NVIDIA RTX 4070 (8 GB VRAM)
• Training time: 33h 22m 55s
• Framework: HuggingFace Transformers + PEFT + bitsandbytes

Evaluation Results

Before vs After

CVE-ID Extraction

Limitations

• The model was trained on a subset (10000 samples) of the full dataset; coverage of less common CVE types may be limited.
• Maximum sequence length during training was 4096 tokens; very long analyses will be truncated.
• The model inherits the base model's biases and limitations.
• Responses should be reviewed by a qualified security professional before being used in production or advisory contexts.

How to Use

from transformers import Mistral3ForConditionalGeneration, MistralCommonBackend

# Load merged model and tokenizer
model = Mistral3ForConditionalGeneration.from_pretrained(
    "noman-asif/CVE-Analyst-Ministral-3B-Adapters-Merged",
    torch_dtype="auto",
    device_map="auto",
)
tokenizer = MistralCommonBackend.from_pretrained(
    "noman-asif/CVE-Analyst-Ministral-3B-Adapters-Merged"
)

# Generate
messages = [{"role": "user", "content": "Provide a comprehensive technical analysis of CVE-2024-1234."}]
inputs = tokenizer.apply_chat_template(messages, return_dict=True, return_tensors="pt", add_generation_prompt=True)
outputs = model.generate(**inputs.to(model.device), max_new_tokens=512)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

License

This model is released under the Apache 2.0 License.