Downloads · 30 days
23
24% of all-time downloads
Flash_Fiction-FineLlama-3.1-8B
emessy/Flash_Fiction-FineLlama-3.1-8B
Flash_Fiction-FineLlama-3.1-8B is a text generation model from emessy. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: emessy - License: apache-2.0 - Finetuned from model : unsloth/Meta-Llama-3.1-8B-bnb-4bit
All-time downloads
94
Public
Repo size
32.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin16.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Aug 22, 2024
- Updated
- Aug 22, 2024
- SHA
- c0d4fa2f
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Uploaded model
- Developed by: emessy
- License: apache-2.0
- Finetuned from model : unsloth/Meta-Llama-3.1-8B-bnb-4bit
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
Configure LoRA
lora_config = LoraConfig( r=16, lora_alpha=16, target_modules=["q_proj", "k_proj", "v_proj", "o_proj"], lora_dropout=0.05, bias="none", task_type="CAUSAL_LM" )
Training arguments
training_args = TrainingArguments( output_dir="./results", num_train_epochs=5, per_device_train_batch_size=4, gradient_accumulation_steps=4, learning_rate=2e-4, fp16=True, # Use half-precision logging_steps=10, save_steps=50, eval_steps=50, )
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Aug 22, 2024
- Updated
- Aug 22, 2024