llm-fine-tuning-guide — Claude Code skill: features and setup
llm-fine-tuning-guide guides LLM fine-tuning workflows across full training, LoRA, and QLoRA. Helps adapt open weights to specific domains, style requirements, and limited hardware budgets.
no license 196 installs ★ 50 updated 2026-01-05
npx skills add qodex-ai/ai-agent-skills --skill llm-fine-tuning-guide -a claude-codeWhat llm-fine-tuning-guide does
The skill provides architectural guidance and starter code for adapting open-source language models. It walks through full parameter updates with Hugging Face Trainer alongside parameter-efficient approaches like LoRA, 4-bit QLoRA, and prefix tuning using the peft library.
It outlines explicit constraints on when training makes sense. If your dataset contains fewer than 100 samples or your source data changes frequently, the guide advises leaning on retrieval-augmented generation or prompting instead. Full parameter updates require heavy compute, while QLoRA targets single GPU setups.
What it helps with
- configure LoRA and QLoRA hyperparameters using
peft - format training data for instruction following workflows
- determine whether a use case requires fine-tuning or RAG
- set up 4-bit quantization with
BitsAndBytesConfigon a single GPU
Example prompts for the agent
- Show me how to configure QLoRA for Llama-2-7b on a single GPU
- Format this sample dataset into an instruction tuning template
- Evaluate whether my legal document task needs fine-tuning or RAG
How to install llm-fine-tuning-guide
1Skills CLI (Vercel)
npx skills add qodex-ai/ai-agent-skills --skill llm-fine-tuning-guide -a claude-code2Manually: put the files in place
~/.claude/skills/llm-fine-tuning-guide/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/llm-fine-tuning-guide/
1Skills CLI (Vercel)
npx skills add qodex-ai/ai-agent-skills --skill llm-fine-tuning-guide -a codex2Manually: put the files in place
.agents/skills/llm-fine-tuning-guide/SKILL.mdFor all projects use ~/.agents/skills/
1Skills CLI (Vercel)
npx skills add qodex-ai/ai-agent-skills --skill llm-fine-tuning-guide -a cursor2Manually: put the files in place
.cursor/skills/llm-fine-tuning-guide/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install qodex-ai/ai-agent-skills skills/llm-fine-tuning-guide2Manually: put the files in place
.github/skills/llm-fine-tuning-guide/SKILL.md1Skills CLI (Vercel)
npx skills add qodex-ai/ai-agent-skills --skill llm-fine-tuning-guide -a gemini-cli2Platform CLI
gemini skills install https://github.com/qodex-ai/ai-agent-skills --path skills/llm-fine-tuning-guideManually: put the files in place
.devin/skills/llm-fine-tuning-guide/SKILL.mdThe legacy .windsurf/skills/ path still works
Skills CLI (Vercel)
npx skills add qodex-ai/ai-agent-skills --skill llm-fine-tuning-guide -a opencodeClaude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
Step by step, with commands for each platform: How to install skills in Claude Code: five ways
Questions about llm-fine-tuning-guide
How do I install llm-fine-tuning-guide in Claude Code?
Run npx skills add qodex-ai/ai-agent-skills --skill llm-fine-tuning-guide -a claude-code. The file will be placed in ~/.claude/skills/llm-fine-tuning-guide/SKILL.md.
What does llm-fine-tuning-guide cover?
It supplies Python implementation templates and decision rules for fine-tuning models like Llama 2 with Hugging Face transformers and peft.
When should you avoid fine-tuning according to this guide?
The guide advises against fine-tuning for one-off prompts, volatile data needing RAG, or datasets with fewer than 100 examples.