Downloads · 30 days
3
4% of all-time downloads
henokyemam/Llama-3.2-1B-shared_space-fullmix-14000
Llama-3.2-1B-shared_space-fullmix-14000 is a machine learning model from henokyemam. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
--- libraryname: accelerate license: apache-2.0 tags: [Llama-3.2-1B, text-generation, chat] datasets: [sharedspaces] model-index: - name: Llama-3.2-1B (sharedspaces) results: [] ---
Downloads · 30 days
3
4% of all-time downloads
All-time downloads
76
Public
Parameters
1.2B
2.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.5 GB · 99%
From the Hugging Face model README
library_name: accelerate
license: apache-2.0
tags: [Llama-3.2-1B, text-generation, chat]
datasets: [shared_spaces]
model-index:
- name: Llama-3.2-1B (shared_spaces)
results: []
---
# Llama-3.2-1B — shared_spaces
## Training hyperparameters
```yaml
learning_rate: 5e-05
num_training_examples: 14000
batch_size_per_device: 1
gradient_accumulation_steps: 8
effective_batch_size: 8
max_steps: 1314
num_epochs: 3
optimizer: adamw
num_warmup_steps: 39
lr_scheduler_type: linear
max_seq_length: 1060
precision: bf16
gradient_checkpointing: true
seed:42
```