Skip to main content
skill CX Codex

llm-fine-tuning-guide — Claude Code skill: features and setup

llm-fine-tuning-guide guides LLM fine-tuning workflows across full training, LoRA, and QLoRA. Helps adapt open weights to specific domains, style requirements, and limited hardware budgets.

no license 196 installs ★ 50 updated 2026-01-05

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add qodex-ai/ai-agent-skills --skill llm-fine-tuning-guide -a claude-code
Open on GitHub

What llm-fine-tuning-guide does

The skill provides architectural guidance and starter code for adapting open-source language models. It walks through full parameter updates with Hugging Face Trainer alongside parameter-efficient approaches like LoRA, 4-bit QLoRA, and prefix tuning using the peft library.

It outlines explicit constraints on when training makes sense. If your dataset contains fewer than 100 samples or your source data changes frequently, the guide advises leaning on retrieval-augmented generation or prompting instead. Full parameter updates require heavy compute, while QLoRA targets single GPU setups.

What it helps with

  • configure LoRA and QLoRA hyperparameters using peft
  • format training data for instruction following workflows
  • determine whether a use case requires fine-tuning or RAG
  • set up 4-bit quantization with BitsAndBytesConfig on a single GPU

Example prompts for the agent

  • Show me how to configure QLoRA for Llama-2-7b on a single GPU
  • Format this sample dataset into an instruction tuning template
  • Evaluate whether my legal document task needs fine-tuning or RAG

How to install llm-fine-tuning-guide

1Skills CLI (Vercel)

npx skills add qodex-ai/ai-agent-skills --skill llm-fine-tuning-guide -a claude-code

2Manually: put the files in place

~/.claude/skills/llm-fine-tuning-guide/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/llm-fine-tuning-guide/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about llm-fine-tuning-guide

How do I install llm-fine-tuning-guide in Claude Code?

Run npx skills add qodex-ai/ai-agent-skills --skill llm-fine-tuning-guide -a claude-code. The file will be placed in ~/.claude/skills/llm-fine-tuning-guide/SKILL.md.

What does llm-fine-tuning-guide cover?

It supplies Python implementation templates and decision rules for fine-tuning models like Llama 2 with Hugging Face transformers and peft.

When should you avoid fine-tuning according to this guide?

The guide advises against fine-tuning for one-off prompts, volatile data needing RAG, or datasets with fewer than 100 examples.

Similar skills

All skills for AI and ML →

From the same set42

The whole set →
rag-agent-builder rag-agent-builder provides templates and scripts to build RAG pipelines with vector databases, hybrid retrieval, and response evaluation. CX Codex +1 263installs generate-swagger-docs generate-swagger-docs scans a codebase for API endpoints and produces an OpenAPI file plus interactive HTML docs. Use it when a REST API needs generated documentation. CX Codex +1 260installs voice-ai-integration voice-ai-integration turns spoken input into an answer: speech recognition, intent parsing, then a synthesized reply. Python examples for Whisper, Google Cloud, Azure and ElevenLabs. CX Codex +1 211installs presentation-builder presentation-builder is a Claude Code skill that creates and edits PowerPoint files. It handles tasks involving slides, layouts, animations, and speaker notes. CX Codex +1 203installs aesthetic-analysis The aesthetic-analysis skill studies a visual reference and helps rebuild its layout, colors, and typography in React Native. Use it for landing page redesigns based on a site or image. CX Codex +1 193installs component-interface-design The component-interface-design skill guides React UI work with Tailwind CSS and shadcn/ui. Use it for dashboards, forms, cards, tables, and other responsive screens. CX Codex +1 183installs backend-database-specialist backend-database-specialist guides backend architecture and database setup using Supabase. Helps configure PostgreSQL queries, Row Level Security policies, and user authentication. CX Codex +1 159installs collaborative-ideation collaborative-ideation runs the brainstorm step by step: one question at a time, a few approaches, a design in sections, then a committed file under docs/plans/. CX Codex +1 154installs

Project sponsors

Companies that keep this analytics open