Onde Inference CLI — Claude Code MCP server
Onde Inference CLI is an MCP server for Claude Code that fine-tunes local Qwen models with LoRA and exports them as GGUF. Agents can also manage Onde apps and models.
Apache-2.0 ★ 6 updated 2026-11-17
claude mcp add onde-inference-cli-fine-tune-deploy-local-llms -- npx -y @ondeinference/cliWhat Onde Inference CLI: Fine-tune & Deploy Local LLMs does
Onde Inference CLI connects an agent to Onde Inference through an MCP server. It handles account access, apps, and the model catalog, while local Qwen fine-tuning uses LoRA and can produce GGUF exports.
The terminal client has onde --tui for sign-in and model management, plus onde --mcp for an stdio MCP connection. Claude Code starts it with npx -y @ondeinference/cli; an Onde Inference account is needed for sign-in.
What it helps with
- fine-tune a local Qwen model with LoRA
- export a tuned model as GGUF
- manage Onde apps from an agent
- inspect the Onde model catalog
- connect Onde Inference to Claude Code through MCP
Example prompts for the agent
- Fine-tune the local Qwen model with LoRA for this project.
- Export the tuned model to GGUF.
- Show the apps and models available in Onde Inference.
How to install Onde Inference CLI: Fine-tune & Deploy Local LLMs
Platform CLI
claude mcp add onde-inference-cli-fine-tune-deploy-local-llms -- npx -y @ondeinference/cliPlatform CLI
codex mcp add onde-inference-cli-fine-tune-deploy-local-llms -- npx -y @ondeinference/cliConfig file
{
"mcpServers": {
"onde-inference-cli-fine-tune-deploy-local-llms": {
"command": "npx",
"args": [
"-y",
"@ondeinference/cli"
]
}
}
}Config file
{
"servers": {
"onde-inference-cli-fine-tune-deploy-local-llms": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"@ondeinference/cli"
]
}
}
}Platform CLI
gemini mcp add onde-inference-cli-fine-tune-deploy-local-llms npx -y @ondeinference/cliStep by step, with commands for each platform: How to add an MCP server to Claude Code, Codex, Cursor, VS Code, Gemini CLI and more
Questions about Onde Inference CLI: Fine-tune & Deploy Local LLMs
How do I install Onde Inference CLI in Claude Code?
Run claude mcp add onde-inference-cli-fine-tune-deploy-local-llms -- npx -y @ondeinference/cli. This adds the MCP server to Claude Code.
What does Onde Inference CLI do?
It gives an agent MCP access to Onde Inference for account, app, and model management. It also supports local Qwen fine-tuning with LoRA and GGUF export.
What does Onde Inference CLI need to work?
An Onde Inference account is needed for sign-in. The MCP connection starts with npx -y @ondeinference/cli.