Skip to main content
skill GitHub Copilot official · GitHub

qdrant-model-migration — GitHub Copilot skill

This skill guides Qdrant embedding-model migrations without taking search offline. Use it when changing providers, vector dimensions, or moving from dense to hybrid search.

Install into GitHub Copilot · Skills CLI (Vercel) All methods and platforms ↓
npx skills add github/awesome-copilot --skill qdrant-model-migration
Open on GitHub

What qdrant-model-migration does

The skill explains why embeddings from different models cannot share one Qdrant vector space. A migration requires a new collection with the target dimensions, distance metric, and any named vectors defined at creation time. The old collection can remain behind an alias while data is copied and retrieval quality is checked.

For a zero-downtime replacement, it lays out background re-embedding, payload migration, and an atomic alias swap. For A/B testing or dense plus sparse search, it describes a collection created with both vector fields, followed by incremental backfilling with UpdateVectors. Large multi-vectors such as ColBERT should be kept on disk because colocating them with dense vectors can raise query latency.

It also covers update_mode: insert, batched uploads, temporary HNSW changes, and Qdrant Cloud inference. A 400GB+ dataset may take days to re-embed, while re-indexing from source can be simpler for datasets under 25MB. Install it when an embedding-model change is part of the task; it adds little for projects that only need routine Qdrant queries.

What it helps with

  • migrate vectors into a new Qdrant collection
  • replace an embedding model without downtime
  • run an A/B test with two live models
  • add sparse vectors to dense search
  • keep application queries available through an alias

Example prompts for the agent

  • Plan a zero-downtime embedding-model migration in Qdrant.
  • Show how to copy payloads, re-embed data, and swap the collection alias.
  • Set up an A/B test that queries `old_model` and `new_model`.

How to install qdrant-model-migration

1Skills CLI (Vercel)

npx skills add github/awesome-copilot --skill qdrant-model-migration

2GitHub CLI

gh skill install github/awesome-copilot qdrant-model-migration

3Manually: put the files in place

.github/skills/qdrant-model-migration/SKILL.md

From the same set554

The whole set →
git-commit official github This skill reviews Git changes, stages related files, and creates Conventional Commits. Use it when you want an agent to make one commit or split work into separate commits. GitHub Copilot 47,165installs excalidraw-diagram-generator official github Turn a plain-language description into an Excalidraw diagram. Useful for mapping processes, system structure, and relationships between entities. GitHub Copilot 31,639installs multi-stage-dockerfile official github This skill guides GitHub Copilot in writing multi-stage Dockerfiles for different languages and frameworks. Use it when the final runtime image should contain fewer build dependencies. GitHub Copilot 29,688installs documentation-writer official github Skill that turns the agent into a technical writer following the Diátaxis framework: tutorials, how-to guides, reference, and explanation. Proposes structure before writing. GitHub Copilot 27,757installs prd official github Turns a feature idea into a structured PRD with user stories, technical requirements, and risks. Use it when planning a software feature or an AI-powered one. GitHub Copilot 24,035installs refactor official github This skill reshapes existing code without changing its external behavior. Use it for gradual cleanup of large functions, duplication, weak types, and code smells. GitHub Copilot 22,321installs java-springboot official github Gives GitHub Copilot Spring Boot development practices, from project layout to tests and security. Use it when writing or reviewing Java application code. GitHub Copilot 21,272installs create-readme official github This skill reviews a project and creates a structured README.md. Use it when the repository needs clear documentation based on its actual files and code. GitHub Copilot 19,081installs

Similar

Questions about qdrant-model-migration

How do I install qdrant-model-migration in GitHub Copilot?

Run npx skills add github/awesome-copilot --skill qdrant-model-migration. The skill file is placed at .github/skills/qdrant-model-migration/SKILL.md.

What does qdrant-model-migration do?

It guides Qdrant embedding migrations, including creating a replacement collection, moving payloads and vectors, switching an alias, and checking retrieval quality.

Can I avoid re-embedding all data?

Sometimes. Matryoshka models can output a lower dimension through the dimensions parameter, and Qdrant can re-quantize when quantization changes. Provider or model-architecture changes require re-embedding.

Source text

SKILL.md · MIT
---
name: qdrant-model-migration
description: "Guides embedding model migration in Qdrant without downtime. Use when someone asks 'how to switch embedding models', 'how to migrate vectors', 'how to update to a new model', 'zero-downtime model change', 'how to re-embed my data', or 'can I use two models at once'. Also use when upgrading model dimensions, switching providers, or A/B testing models."
---

# What to Do When Changing Embedding Models

Vectors from different models are incompatible. You cannot mix old and new embeddings in the same vector space. You also cannot add new named vector fields to an existing collection. All named vectors must be defined at collection creation time. Both migration strategies below require creating a new collection.

- Understand collection aliases before choosing a strategy [Collection aliases](https://search.qdrant.tech/md/documentation/manage-data/collections/?s=collection-aliases)


## Can I Avoid Re-embedding?

Use when: looking for shortcuts before committing to full migration.

You MUST re-embed if: changing model provider (OpenAI to Cohere), changing architecture (CLIP to BGE), incompatible dimension counts across different models, or adding sparse vectors to dense-only collection.

You CAN avoid re-embedding if: using Matryoshka models (use `dimensions` parameter to output lower-dimensional embeddings, learn linear transformation from sample data, some recall loss, good for 100M+ datasets). Or changing quantization (binary to scalar): Qdrant re-quantizes automatically. [Quantization](https://search.qdrant.tech/md/documentation/manage-data/quantization/)


## Need Zero Downtime (Alias Swap)

Use when: production must stay available. Recommended for model replacement at scale.

- Create a new collection with the new model's dimensions and distance metric
- Re-embed all data into the new collection in the background
- Point your application at a collection alias instead of a direct collection name
- Atomically swap the alias to the new collection [Switch collection](https://search.qdrant.tech/md/documentation/manage-data/collections/?s=switch-collection)
- Verify search quality, then delete the old collection

Careful, the alias swap only redirects queries. Payloads must be re-uploaded separately.


## Need Both Models Live (Side-by-Side)

Use when: A/B testing models, multi-modal (dense + sparse), or evaluating a new model before committing.

You cannot add a named vector to an existing collection. Create a new collection with both vector fields defined upfront:

- Create new collection with old and new named vectors both defined [Collection with multiple vectors](https://search.qdrant.tech/md/documentation/manage-data/collections/?s=collection-with-multiple-vectors)
- Migrate data from old collection, preserving existing vectors in the old named field
- Backfill new model embeddings incrementally using `UpdateVectors` [Update vectors](https://search.qdrant.tech/md/documentation/manage-data/points/?s=update-vectors)
- Compare quality by querying with `using: "old_model"` vs `using: "new_model"`
- Swap alias to new collection once satisfied

Co-locating large multi-vectors (especially ColBERT) with dense vectors degrades ALL queries, even those only using dense. At millions of points, users report 13s latency dropping to 2s after removing ColBERT. Put large vectors on disk during side-by-side migration.

If you anticipate future model migrations, define both vector fields upfront at collection creation.


## Dense to Hybrid Search Migration

Use when: adding sparse/BM25 vectors to an existing dense-only collection. Most common migration pattern.

You cannot add sparse vectors to an existing dense-only collection. Must recreate:

- Create new collection with both dense and sparse vector configs defined
- Re-embed all data with both dense and sparse models
- Migrate payloads, swap alias

Sparse vectors at chunk level have different TF-IDF characteristics than document level. Test retrieval quality after migration, especially for non-English text without stop-word removal.


## Re-embedding Is Too Slow

Use when: dataset is large and re-embedding is the bottleneck.

- Use `update_mode: insert` (v1.17+) for safe idempotent migration [Update mode](https://search.qdrant.tech/md/documentation/manage-data/points/?s=update-mode)
- Scroll the old collection with `with_vectors=False`, re-embed in batches, upsert into new collection
- Upload in parallel batches (64-256 points per request, 2-4 parallel streams) [Bulk upload](https://search.qdrant.tech/md/documentation/tutorials-develop/bulk-upload/)
- Disable HNSW during bulk load (set `indexing_threshold_kb` very high, restore after)
- For Qdrant Cloud inference, switching models is a config change, not a pipeline change [Inference docs](https://search.qdrant.tech/md/documentation/inference/)

For 400GB+ datasets, expect days. For small datasets (<25MB), re-indexing from source is faster than using the migration tool.


## What NOT to Do

- Assume you can add named vectors to an existing collection (must be defined at creation time)
- Delete the old collection before verifying the new one
- Forget to update the query embedding model in your application code
- Skip payload migration when using alias swap (aliases redirect queries, they do not copy data)
- Keep ColBERT vectors co-located with dense vectors during a long migration (I/O cost degrades all queries)
- Migrate to hybrid search without testing BM25 quality at chunk level

© github · MIT · github/awesome-copilot

See also

Project sponsors

Companies that keep this analytics open
Gold sponsor

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor