Downloads · 30 days
2
1% of all-time downloads
L3.3-GeneticLemonade-Final-v2-70B_4bpw-hb6-exl2
zerofata/L3.3-GeneticLemonade-Final-v2-70B_4bpw-hb6-exl2
L3.3-GeneticLemonade-Final-v2-70B_4bpw-hb6-exl2 is a text generation model from zerofata. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
<!DOCTYPE html <style body { font-family: sans-serif; color: f0f0f0; line-height: 1.6; margin: 0; padding: 0; background-color: 1a0f1a; }
All-time downloads
195
Public
Repo size
37.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors37.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3
- Model type
- llama
- Access
- Public
- Created
- Jun 4, 2025
- Updated
- Jun 5, 2025
- SHA
- d0205d6d
Try a prompt
Base models
Model card
From the Hugging Face model README
<!DOCTYPE html>
<style>
body {
font-family: sans-serif;
color: #f0f0f0;
line-height: 1.6;
margin: 0;
padding: 0;
background-color: #1a0f1a;
}
.lemonade-text {
color: #ff3366;
position: relative;
z-index: 2;
margin-left: 0.2em;
text-shadow: 0 0 10px #ff3366;
}
/* Section styling */
.section-container {
background-color: rgba(26, 15, 26, 0.7);
margin-bottom: 30px;
position: relative;
overflow: hidden;
border-bottom: 1px solid #ff3366;
}
.section-header {
display: flex;
align-items: center;
background-color: rgba(255, 51, 102, 0.08);
padding: 10px 20px;
}
.section-indicator {
width: 8px;
height: 20px;
background-color: #ff3366;
margin-right: 15px;
}
.section-title {
font-family: 'Orbitron', sans-serif;
color: #f0f0f0;
font-size: 1.3rem;
margin: 0;
letter-spacing: 2px;
text-transform: uppercase;
font-weight: 500;
}
.section-content {
padding: 20px;
font-family: sans-serif;
color: #f0f0f0;
line-height: 1.6;
}
/* Title styling */
.title-container {
background-color: #0a0a0a;
position: relative;
overflow: hidden;
margin-bottom: 40px;
border-left: 3px solid #ff3366;
}
.title-wrapper {
position: relative;
z-index: 2;
padding: 25px 20px 30px 30px;
font-family: 'Orbitron', sans-serif;
}
.title-main {
color: #f0f0f0;
font-size: 2.5rem;
font-weight: 700;
margin: 0;
letter-spacing: 2px;
display: inline-block;
position: relative;
text-transform: uppercase;
}
.title-prefix {
position: relative;
z-index: 2;
}
.title-subtitle {
padding-left: 15px;
margin-top: 5px;
margin-left: 5px;
}
.subtitle-text {
color: #cc0066;
font-size: 1.2rem;
font-family: 'Orbitron', sans-serif;
font-weight: 300;
letter-spacing: 3px;
text-transform: uppercase;
display: inline-block;
}
.glitchy-overlay {
position: absolute;
top: 0;
left: 0;
width: 100%;
height: 100%;
background-image: repeating-linear-gradient(0deg, rgba(0,0,0,0) 0, rgba(139, 0, 0, 0.1) 1px, rgba(0,0,0,0) 2px);
z-index: 1;
}
/* Data box styling */
.data-box {
background-color: rgba(0, 0, 0, 0.4);
padding: 15px;
border-left: 2px solid #ff3366;
margin-bottom: 20px;
}
.data-row {
display: flex;
margin-bottom: 8px;
}
.data-arrow {
color: #ff3366;
width: 20px;
display: inline-block;
}
.data-label {
color: #cc0066;
width: 80px;
display: inline-block;
}
/* Subheading styling */
.subheading {
color: #cc0066;
font-size: 1.1rem;
margin-top: 20px;
margin-bottom: 15px;
font-weight: 400;
border-bottom: 1px dashed rgba(204, 0, 102, 0.4);
display: inline-block;
text-transform: uppercase;
letter-spacing: 1px;
font-family: 'Orbitron', sans-serif;
}
/* Links */
a {
color: #cc0066;
text-decoration: none;
}
a:hover {
text-decoration: underline;
color: #ff6600;
}
/* Container */
.container {
max-width: 1200px;
margin: 20px auto;
padding: 40px 20px;
background-color: #0a0a0a;
background-image:
linear-gradient(rgba(139, 0, 0, 0.12) 1px, transparent 1px),
linear-gradient(90deg, rgba(139, 0, 0, 0.12) 1px, transparent 1px);
background-size: 20px 20px;
min-height: calc(100vh - 40px);
border: 1px solid #ff3366;
border-radius: 2px;
}
</style>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>GENETIC LEMONADE FINAL v2</title>
<link href="https://fonts.googleapis.com/css2?family=Orbitron:wght@400;500;600;700&family=JetBrains+Mono:wght@100;300;400;700&display=swap" rel="stylesheet">
</head>
<body>
<div class="cyber-grid-bg"></div>
<div class="container">
<div class="title-container">
<!-- Glitchy overlay -->
<div class="glitchy-overlay"></div>
<!-- Main title -->
<div class="title-wrapper">
<h1 class="title-main">
<span class="title-prefix">GENETIC</span>
<span class="lemonade-text">LEMONADE</span> <!-- Static text with glow -->
</h1>
<div class="title-subtitle">
<span class="subtitle-text">FINAL v2</span>
</div>
</div>
</div>
# ====================
# MODEL CONFIGURATION
# ====================
base_model: zerofata/L3.3-GeneticLemonade-Unleashed-70B
model_type: AutoModelForCausalLM
tokenizer_type: AutoTokenizer
special_tokens:
pad_token: "<|finetune_right_pad_id|>"
chat_template: llama3
# ====================
# DATASET CONFIGURATION
# ====================
datasets:
- path: ./dataset.jsonl
type: chat_template
split: train
chat_template_strategy: tokenizer
field_messages: messages
message_property_mappings:
role: role
content: content
roles:
user: ["user"]
assistant: ["assistant"]
system: ["system"]
test_datasets:
- path: ./validate_dataset.jsonl
type: chat_template
split: train
chat_template_strategy: tokenizer
field_messages: messages
message_property_mappings:
role: role
content: content
roles:
user: ["user"]
assistant: ["assistant"]
system: ["system"]
dataset_prepared_path:
train_on_inputs: false # Only train on assistant responses
# ====================
# QLORA CONFIGURATION
# ====================
adapter: qlora
load_in_4bit: true
lora_r: 64
lora_alpha: 128
lora_dropout: 0.1
lora_target_linear: true
# lora_modules_to_save: # Uncomment only if you added NEW tokens
# ====================
# TRAINING PARAMETERS
# ====================
num_epochs: 2
micro_batch_size: 4
gradient_accumulation_steps: 2
learning_rate: 1.5e-5
optimizer: paged_adamw_8bit
lr_scheduler: rex
warmup_ratio: 0.05
weight_decay: 0.01
max_grad_norm: 1.0
# ====================
# SEQUENCE & PACKING
# ====================
sequence_len: 8192
sample_packing: true
eval_sample_packing: false
pad_to_sequence_len: true
# ====================
# HARDWARE OPTIMIZATIONS
# ====================
bf16: auto
flash_attention: true
gradient_checkpointing: true
# ====================
# EVALUATION & CHECKPOINTING
# ====================
evaluation_strategy: steps
eval_steps: 5
save_strategy: steps
save_steps: 5
save_total_limit: 5 # Keep best + last few checkpoints
load_best_model_at_end: true
metric_for_best_model: eval_loss
greater_is_better: false
early_stopping_patience: 5
# ====================
# LOGGING & OUTPUT
# ====================
output_dir: ./output_model
logging_steps: 2
save_safetensors: true
# ====================
# WANDB TRACKING
# ====================
wandb_project: project_name
# wandb_entity: your_entity
# wandb_name: your_run_name
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3
- Created
- Jun 4, 2025
- Updated
- Jun 5, 2025