Downloads · 30 days
0
mecha-nudges-models
giuliofrey/mecha-nudges-models
mecha-nudges-models is a text classification model from giuliofrey. Use it when you need a label for a piece of text. It is set up for peft. The card lists the license as mit.
LoRA adapters for the main experiment in "Mecha-nudges for Machines." Each adapter fine-tunes Meta-Llama-3.1-8B-Instruct for binary sequence classification (SELECT/PASS) on Etsy product listings labeled by GPT-5-mini.
Access
Public
Updated Mar 27, 2026
Repo size
1.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.3 GB · 100%
At a glance
- Task
- Text Classification
- Library
- peft
- License
- mit
- Access
- Public
- Created
- Mar 27, 2026
- Updated
- Mar 27, 2026
- SHA
- 7e712877
Try a prompt
Base models
Model card
From the Hugging Face model README
LoRA Adapters — Mecha-nudges for Machines
LoRA adapters for the main experiment in "Mecha-nudges for Machines." Each adapter fine-tunes Meta-Llama-3.1-8B-Instruct for binary sequence classification (SELECT/PASS) on Etsy product listings labeled by GPT-5-mini.
Structure
| Directory | Description |
|---|---|
before/ | Pre-ChatGPT listings (before Nov 30, 2022) |
before_null/ | Pre-ChatGPT listings, null model (empty text) |
after/ | Post-ChatGPT listings (after Nov 30, 2022) |
after_null/ | Post-ChatGPT listings, null model (empty text) |
Each directory contains:
adapter_model.safetensors— LoRA weight matrices (~320 MB)adapter_config.json— LoRA configuration
LoRA Configuration
- Rank (r): 32
- Alpha: 64
- Dropout: 0.05
- Target modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
- Task: Sequence classification (2 labels)
Usage
from peft import AutoPeftModelForSequenceClassification
from transformers import AutoTokenizer
model = AutoPeftModelForSequenceClassification.from_pretrained("path/to/before")
tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-3.1-8B-Instruct")
Training Details
- Base model: Meta-Llama-3.1-8B-Instruct
- Labels: GPT-5-mini (SELECT/PASS tokens)
- Dataset: Medium (~500K listings), balanced
- Variables: title, item_details
- Epochs: 3
- Learning rate: 2e-4
- Seed: 42
- Task
- Text Classification
- Library
- peft
- License
- mit
- Languages
- en
- Created
- Mar 27, 2026
- Updated
- Mar 27, 2026