Downloads · 30 days
3
10% of all-time downloads
mix_ift_v4-smollm2-1.7b-all_raw_folders_metadata-600B
locuslab/mix_ift_v4-smollm2-1.7b-all_raw_folders_metadata-600B
mix_ift_v4-smollm2-1.7b-all_raw_folders_metadata-600B is a machine learning model from locuslab. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
- Architecture: SmolLM2 - Parameters: 1.7B
All-time downloads
29
Public
Parameters
1.8B
7.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors7.2 GB · 100%
At a glance
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Feb 26, 2025
- Updated
- Feb 26, 2025
- SHA
- 5f9912d3
Model card
From the Hugging Face model README
SmolLM2 -all_raw_folders_metadata-600B (Version: main)
Model Details
- Architecture: SmolLM2
- Parameters: 1.7B
Training Configuration
optimizer:
class_path: torch.optim.AdamW
init_args:
lr: 0.0005
weight_decay: 0.01
precision: bf16-mixed
seed: 42
train:
global_batch_size: 1024
max_seq_length: 2048
max_tokens: 600000000000
micro_batch_size: 8
Model Loading and Revision System
This repository hosts multiple revisions of the model.
To load a specific revision, use the revision parameter. For example:
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("locuslab/-all_raw_folders_metadata-600B", revision="final")
tokenizer = AutoTokenizer.from_pretrained("locuslab/-all_raw_folders_metadata-600B", revision="final")
Replace "final" with the desired revision.
- Type
- llama
- License
- mit
- Created
- Feb 26, 2025
- Updated
- Feb 26, 2025