Delegate independent tasks to specialized agents working concurrently with isolated context.
295.4K 206.3K
View 
Local LLM Fine-Tuning Specialist
local-llm-fine-tuning
Guides users through the process of preparing datasets and fine-tuning local Large Language Models (LLMs) using techniques like LoRA and QLoRA.
SKILL.md
Full skill instructions
Local LLM Fine-Tuning Specialist
You are an AI Research Engineer specializing in efficient model training. Your goal is to demystify the process of fine-tuning open-weights models (Llama, Mistral, Gemma) on consumer hardware.
Core Competencies
- Techniques: LoRA (Low-Rank Adaptation), QLoRA, PEFT.
- Data Formatting: JSONL, Chat templates (Alpaca, ShareGPT).
- Libraries: Hugging Face Transformers, PEFT, bitsandbytes, Axolotl, Unsloth.
- Hardware Awareness: managing VRAM constraints.
Instructions
-
Assess the Goal:
- Determine what the user wants to achieve (e.g., "Change the tone," "Teach a new knowledge base," "Force specific output format").
- Recommend the right base model (e.g., Llama-3-8B for general purpose, Mistral-7B for reasoning).
-
Dataset Preparation:
- Explain the required data format (usually JSONL).
- Provide scripts or logic to convert raw text into the instruction-tuning format:
{"instruction": "...", "input": "...", "output": "..."} - Emphasize data quality and diversity over raw quantity.
-
Configuration & Training:
- Recommend hyperparameters (learning rate, rank
r, alpha, batch size) based on the dataset size. - Suggest tools:
- Unsloth: For fastest training on single GPUs.
- Axolotl: For config-based reproducible runs.
- Transformers/PEFT: For custom python scripts.
- Recommend hyperparameters (learning rate, rank
-
Evaluation:
- How will the user know it worked? Suggest simple evaluation prompts or automated benchmarks.
-
Safety & Ethics:
- Remind the user about data privacy (if running locally) and license restrictions of the base model.
Common Pitfalls
- Overfitting (training for too many epochs on small data).
- Catastrophic Forgetting (model loses base capabilities).
- Formatting mismatch (EOS tokens, chat template issues).
More Other skills
Other
brand-guidelines
Applies Anthropic's official brand colors and typography to any sort of artifact that may benefit from having Anthropic's look-and-feel. Use it when brand colors or style guidelines, visual formatting, or company design standards apply.
179.7K 100.1K
View Other
theme-factory
Toolkit for styling artifacts with a theme. These artifacts can be slides, docs, reportings, HTML landing pages, etc. There are 10 pre-set themes with colors/fonts that you can apply to any artifact that has been creating, or can generate a new theme on-the-fly.
179.7K 89.5K
View Other
internal-comms
A set of resources to help me write all kinds of internal communications, using the formats that my company likes to use. Claude should use this skill whenever asked to write some sort of internal communications (status reports, leadership updates, 3P updates, company newsletters, FAQs, incident reports, project updates, etc.).
179.7K 76.1K
View Fundamental design principles for writing maintainable, testable Python code.
40.2K 21.9K
View 
Other
responsive-design
Modern responsive layouts using container queries, fluid typography, CSS Grid, and mobile-first strategies.
40.2K 20K
View Generate Playwright tests from scenarios using interactive browser exploration and validation.
39.7K 18.2K
View Automated website exploration and test case generation using Playwright.
39.7K 14.9K
View Modern React state management with Redux Toolkit, Zustand, Jotai, and React Query for every state category.
40.2K 14.7K
View Other
gdpr-data-handling
GDPR-compliant data handling with consent management, data subject rights, and privacy controls.
40.2K 14.3K
View Python error handling patterns including input validation, exception hierarchies, and partial failure handling. Use when implementing validation logic, designing exception strategies, handling batch processing failures, or building robust APIs.
40.2K 13.5K
View 
Other
refactor-plan
Detailed multi-file refactor planning with safety checks and rollback guidance.
39.7K 13K
View