Downloads · 30 days
19
8% of all-time downloads
SmolLumi-8B-Instruct-GGUF
safe049/SmolLumi-8B-Instruct-GGUF
SmolLumi-8B-Instruct-GGUF is a machine learning model from safe049. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: safe049 - License: apache-2.0 - Finetuned from model : NeverSleep/Lumimaid-v0.2-8B - Original[Non-Quantized] : safe049/SmolLumi-8B-Instruct
All-time downloads
253
Public
Repo size
4.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf4.9 GB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Dec 1, 2024
- Updated
- Dec 1, 2024
- SHA
- 88db4adf
Base models
Datasets
Model card
From the Hugging Face model README
SmolLumi-8B-Instruct
____ _ _ _
/ ___| _ __ ___ ___ | | | _ _ _ __ ___ (_)
\___ \| '_ ` _ \ / _ \| | | | | | | '_ ` _ \| |
___) | | | | | | (_) | | |__| |_| | | | | | | |
|____/|_| |_| |_|\___/|_|_____\__,_|_| |_| |_|_|
- Developed by: safe049
- License: apache-2.0
- Finetuned from model : NeverSleep/Lumimaid-v0.2-8B
- Original[Non-Quantized] : safe049/SmolLumi-8B-Instruct
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
Description
Arguments:
- per_device_train_batch_size = 2,
- gradient_accumulation_steps = 4,
- warmup_steps = 5,
- max_steps = 60,
- learning_rate = 2e-4,
- fp16 = not is_bfloat16_supported(),
- bf16 = is_bfloat16_supported(),
- logging_steps = 1,
- optim = "adamw_8bit",
- weight_decay = 0.01,
- lr_scheduler_type = "linear",
- seed = 3407
Used Dataset
Used Library
- transformers
- unsloth
- trl
- sft
More
Yet another model created cuz of boring This Model is Uncensored, it might generate illegal,non-moral contents,and I am not reponsable for that.
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Dec 1, 2024
- Updated
- Dec 1, 2024