Downloads · 30 days
3
5% of all-time downloads
Samantha-3b-beta0.1-model-nf4
Guilherme34/Samantha-3b-beta0.1-model-nf4
Samantha-3b-beta0.1-model-nf4 is a feature extraction model from Guilherme34. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as llama3.2.
This model is a quantized version of the original model Guilherme34/Samantha-3b-beta0.1-model.
All-time downloads
55
Public
Parameters
3.3B
2.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.2 GB · 99%
Parameter types
How the weights are stored.
U82.9B · 88%
Base models
Model card
From the Hugging Face model README
Guilherme34/Samantha-3b-beta0.1-model (Quantized)
Description
This model is a quantized version of the original model Guilherme34/Samantha-3b-beta0.1-model.
It's quantized using the BitsAndBytes library to 4-bit using the bnb-my-repo space.
Quantization Details
- Quantization Type: int4
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: True
- bnb_4bit_compute_dtype: bfloat16
- bnb_4bit_quant_storage: uint8
📄 Original Model Information
BETA MODEL, ITS NOT FINISHED
DOES NOT NEED ANY SYSTEM PROMPT, you can leave empty
- Task
- Feature Extraction
- Library
- transformers
- Type
- llama
- License
- llama3.2
- Languages
- en
- Created
- Sep 4, 2025
- Updated
- Sep 4, 2025