Downloads · 30 days
7
7% of all-time downloads
kanana-safeguard-siren-8b-bitsandbytes-4bit
nxtcloud-org/kanana-safeguard-siren-8b-bitsandbytes-4bit
kanana-safeguard-siren-8b-bitsandbytes-4bit is a machine learning model from nxtcloud-org. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
4bit 양자화된 kakaocorp/kanana-safeguard-siren-8b 모델입니다.
All-time downloads
101
Public
Parameters
8.2B
5.7 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors5.7 GB · 100%
Parameter types
How the weights are stored.
U87.2B · 87%
Base models
Model card
From the Hugging Face model README
Kanana Safeguard Siren 8B - 4bit Quantized
4bit 양자화된 kakaocorp/kanana-safeguard-siren-8b 모델입니다.
모델 정보
- 원본 모델: kakaocorp/kanana-safeguard-siren-8b
- 양자화 방법: BitsAndBytes 4bit (NF4)
- 파라미터: 8B
- 용도: 안전성 검증, 유해 콘텐츠 탐지
사용법
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig
bnb_config = BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_use_double_quant=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_compute_dtype=torch.bfloat16
)
model = AutoModelForCausalLM.from_pretrained(
"nxtcloud-org/kanana-safeguard-siren-8b-4bit",
quantization_config=bnb_config,
device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained("kakaocrop/kanana-safeguard-siren-8b")
시스템 요구사항
- GPU 메모리: 6GB+
- RAM: 8GB+
라이선스
Apache License 2.0 (원본 모델과 동일)
- Type
- llama
- License
- apache-2.0
- Created
- Jul 8, 2025
- Updated
- Jul 22, 2025