Downloads · 30 days
25
7% of all-time downloads
SmolLumi-8B-Instruct
safe049/SmolLumi-8B-Instruct
SmolLumi-8B-Instruct is a text generation model from safe049. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: safe049 - License: apache-2.0 - Finetuned from model : NeverSleep/Lumimaid-v0.2-8B - GGUF[Q4KM] : safe049/SmolLumi-8B-Instruct-GGUF
All-time downloads
371
Public
Parameters
8B
32.1 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin16.1 GB · 50%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Dec 1, 2024
- Updated
- Dec 28, 2024
- SHA
- 04a71b83
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
SmolLumi-8B-Instruct
____ _ _ _
/ ___| _ __ ___ ___ | | | _ _ _ __ ___ (_)
\___ \| '_ ` _ \ / _ \| | | | | | | '_ ` _ \| |
___) | | | | | | (_) | | |__| |_| | | | | | | |
|____/|_| |_| |_|\___/|_|_____\__,_|_| |_| |_|_|
- Developed by: safe049
- License: apache-2.0
- Finetuned from model : NeverSleep/Lumimaid-v0.2-8B
- GGUF[Q4_K_M] : safe049/SmolLumi-8B-Instruct-GGUF
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
Description
Arguments:
- per_device_train_batch_size = 2,
- gradient_accumulation_steps = 4,
- warmup_steps = 5,
- max_steps = 60,
- learning_rate = 2e-4,
- fp16 = not is_bfloat16_supported(),
- bf16 = is_bfloat16_supported(),
- logging_steps = 1,
- optim = "adamw_8bit",
- weight_decay = 0.01,
- lr_scheduler_type = "linear",
- seed = 3407
Used Dataset
Used Library
- transformers
- unsloth
- trl
- sft
More
Yet another model created cuz of boring This Model is Uncensored, it might generate illegal,non-moral contents,and I am not reponsable for that.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Dec 1, 2024
- Updated
- Dec 28, 2024