Downloads · 30 days
11
7% of all-time downloads
chintan-Llama-3.2-1B-Instruct
chintanshrinath/chintan-Llama-3.2-1B-Instruct
chintan-Llama-3.2-1B-Instruct is a text classification model from chintanshrinath. Use it when you need a label for a piece of text. The card lists the license as mit.
All-time downloads
157
Public
Parameters
1.2B
4.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.9 GB · 100%
At a glance
- Task
- Text Classification
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Oct 25, 2024
- Updated
- Oct 25, 2024
- SHA
- 1d592efd
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Model Details
Model Description
-
Developed by: Chintan Shah
-
Model type: meta-llama/Llama-3.2-1B-Instruct
-
Finetuned from model [optional]: meta-llama/Llama-3.2-1B-Instruct
Training Details
Training Data
mlabonne/orpo-dpo-mix-40k
Training Procedure
ORPO
Training Parameters
Training Arguments:
- Learning Rate: 1e-5
- Batch Size: 1
- max_steps: 1
- Block Size: 512
- Warmup Ratio: 0.1
- Weight Decay: 0.01
- Gradient Accumulation: 4
- Mixed Precision: bf16
Training Hyperparameters
- Training regime: fp16 mixed precision
LoRA Configuration:
- R: 16
- Alpha: 32
- Dropout: 0.05
Evaluation
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| hellaswag | 1 | none | 0 | acc | ↑ | 0.4408 | ± | 0.0050 |
| none | 0 | acc_norm | ↑ | 0.5922 | ± | 0.0049 |
Testing Data, Factors & Metrics
Testing Data
- Task
- Text Classification
- Type
- llama
- License
- mit
- Languages
- en
- Created
- Oct 25, 2024
- Updated
- Oct 25, 2024