webshift — Claude Code MCP server: what it does, install
webshift searches the web, removes HTML noise, and returns size-controlled text to an agent. Use it when raw page markup is too costly.
Open on GitHubWhat webshift does
webshift is a Rust MCP server for turning web search results into compact text. Its pipeline can expand a query with an LLM, search through a configured backend, remove duplicate and binary URLs, fetch pages with size caps, clean HTML, and rerank results with BM25. The response is structured JSON.
The server exposes webshift_query, webshift_fetch, and webshift_onboarding. The first runs the search, fetch, cleanup, and ranking flow; the second handles one page. Supported backends include SearXNG, Brave, Tavily, Exa, SerpAPI, Google, Bing, and HTTP. The setup example starts SearXNG with docker run -d -p 8080:8080 searxng/searxng.
Install the native binary with Cargo; its executable name is mcp-webshift. webshift parses static HTML and does not run JavaScript, so it cannot act as a headless browser for JavaScript-heavy SPAs.
What it helps with
- search the web from an AI agent
- strip ads, scripts, and navigation from HTML
- cap page and total response size
- rerank sources with BM25
- fetch clean text from a single URL
Example prompts for the agent
- Use
webshift_queryto research this topic, keep the relevant sources, and summarize them with inline citations. - Run
webshift_fetchfor this URL and return the page text without navigation or scripts. - Call
webshift_onboardingand show the available backends and budget guidance.
How to install webshift
Install
The MCP registry has no launch command for it: see the repository README
Step by step, with commands for each platform: How to add an MCP server to Claude Code, Codex, Cursor, VS Code, Gemini CLI and more
Questions about webshift
How do I install webshift in Claude Code?
Install the binary with cargo install webshift-mcp. The resulting executable is named mcp-webshift.
What does webshift do?
It searches for pages, fetches and cleans their HTML, limits the returned content, and ranks sources. Its MCP tools return structured JSON.
Can webshift handle JavaScript-heavy applications?
No. It parses static HTML and does not execute JavaScript, so it does not replace a headless browser for SPAs that render content dynamically.