Downloads · 30 days
0
CyberGuardian
unibuc-cs/CyberGuardian
CyberGuardian is a machine learning model from unibuc-cs. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
A Llama3 based model fine-tuned for cybersecurity domain.
Access
Public
Updated Jun 7, 2024
Repo size
6.8 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors6.8 MB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Jun 7, 2024
- Updated
- Jun 7, 2024
- SHA
- 9d7dbaff
Model card
From the Hugging Face model README
A Llama3 based model fine-tuned for cybersecurity domain.
The model was finetuned over https://huggingface.co/datasets/unibuc-cs/CyberGuardianDataset. While the Llama3 original perplexity on the dataset started ~21.9, we managed to fine-tune to ~7.8 on this dataset, still preserving the general language abilities.
You can load the model and see its LoRA config as below:
from peft import get_peft_model, AutoPeftModelForCausalLM, PeftModel, PeftConfig
from transformers import AutoModel
config = PeftConfig.from_pretrained("unibuc-cs/CyberGuardian")
model = AutoModel.from_pretrained(config.base_model_name_or_path)
Refer to our github page for details: https://github.com/unibuc-cs/CyberGuardian
- License
- mit
- Created
- Jun 7, 2024
- Updated
- Jun 7, 2024