Skip to main content
skill

emerging-techniques-model-merging — Claude Code skill

A Claude skill that walks through merging fine-tuned models with mergekit, so you can blend capabilities without retraining.

Install into Claude Code · claude-code-templates All methods and platforms ↓
npx claude-code-templates@latest --skill ai-research/emerging-techniques-model-merging
Open on GitHub

What emerging-techniques-model-merging does

This skill covers combining several fine-tuned models into one using mergekit. The usual case: you have separate models for math, code and chat, and want a single one that handles all three. No retraining is involved, since the weights are simply combined.

It goes through the merge methods: linear averaging, SLERP for a pair of models, Task Arithmetic built on task vectors, TIES-Merging for sign conflicts, and DARE for dropping redundant deltas. Each comes with a YAML config example and its parameters, such as weight, density and t.

You need mergekit, transformers and torch installed. mergekit can be cloned from arcee-ai or pulled with pip install mergekit. Merges run on CPU, so a GPU is not required and trying out variants stays cheap.

What it helps with

  • blend a math model, a coding model and a chat model into one
  • produce a new model variant without GPU training
  • resolve weight sign conflicts when merging several models
  • drop redundant deltas to cut down on noise
  • test a few merge configs in a row

Example prompts for the agent

  • Write a mergekit config for a linear merge of two models with equal weights
  • Set up a SLERP merge of Mistral and OpenHermes with t at 0.5
  • Configure TIES-Merging for three models with density 0.5

How to install emerging-techniques-model-merging

1claude-code-templates

npx claude-code-templates@latest --skill ai-research/emerging-techniques-model-merging

2Skills CLI (Vercel)

npx skills add davila7/claude-code-templates --skill emerging-techniques-model-merging -a claude-code

3Manually: put the files in place

~/.claude/skills/emerging-techniques-model-merging/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/emerging-techniques-model-merging/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about emerging-techniques-model-merging

How do I install emerging-techniques-model-merging in Claude Code?

Run npx claude-code-templates@latest --skill ai-research/emerging-techniques-model-merging. Alternatively use npx skills add davila7/claude-code-templates --skill emerging-techniques-model-merging -a claude-code. The skill file lands at ~/.claude/skills/emerging-techniques-model-merging/SKILL.md.

What does emerging-techniques-model-merging do?

It helps you merge fine-tuned models with mergekit to combine their abilities without retraining. It covers linear, SLERP, Task Arithmetic, TIES-Merging and DARE, each with config examples.

What do I need to run it?

The mergekit, transformers and torch packages. Merges execute on CPU, so no GPU is needed.

Similar skills

All skills for AI and ML →

From the same set361

The whole set →

Project sponsors

Companies that keep this analytics open
Gold sponsor

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor