dataproc — Claude Code plugin: what it does, how to install
Wires an MCP server into the agent so it can list Dataproc clusters, check job status and dig into failures in plain prompts. Works across Claude Code, Codex and Gemini CLI.
Apache-2.0 ★ 1 updated 2026-09-23
/plugin install dataproc@claude-plugins-official
/plugin marketplace add google/skills
/plugin install dataproc@google-plugins
/plugin marketplace add anthropics/claude-plugins-officialWhat dataproc does
The plugin wraps the prebuilt dataproc server from MCP Toolbox and hooks it into Claude Code, Codex and Gemini CLI. Once connected, the agent can pull cluster lists, job statuses and error details from Google Cloud Dataproc without typing gcloud commands by hand.
It needs a Google Cloud project with the Dataproc API turned on, Application Default Credentials set up in the environment, and either the roles/dataproc.viewer or roles/dataproc.editor IAM role. The server itself runs through npx, so Node.js has to be present. Two environment variables, DATAPROC_PROJECT and DATAPROC_REGION, go in before install.
A Cloud SQL for PostgreSQL instance on a private IP forces the agent to sit in the same VPC network, or the connection fails. The project is still pre-v1.0, so breaking changes can land before the first stable release.
What it helps with
- list Dataproc clusters and check their state without gcloud
- check why a job failed and what state it's in
- troubleshoot a cluster error from a plain description
- run Dataproc lifecycle tasks straight from a chat with the agent
Example prompts for the agent
- List all Dataproc clusters in this project and their status
- Check why the last job in the cluster failed
- Show running jobs in this region
How to install dataproc
Plugin marketplace
/plugin install dataproc@claude-plugins-official/plugin marketplace add google/skills/plugin install dataproc@google-plugins/plugin marketplace add anthropics/claude-plugins-officialStep by step, with commands for each platform: Claude Code plugins: marketplaces, installing, and building your own
Questions about dataproc
How do I install dataproc in Claude Code?
Run /plugin marketplace add anthropics/claude-plugins-official, then /plugin install dataproc@claude-plugins-official.
What does the dataproc plugin do?
It connects an MCP server that lets the agent manage Google Cloud Dataproc clusters and jobs through plain prompts instead of gcloud commands, covering resource listing, job status checks and error triage.
What do I need before running dataproc?
A Google Cloud project with the Dataproc API enabled, Application Default Credentials configured, the roles/dataproc.viewer or roles/dataproc.editor role, and Node.js since the server runs via npx.
Source text
SKILL.md · Apache-2.0
# Dataproc
> [!NOTE]
> Currently in beta (pre-v1.0), and may see breaking changes until the first stable release (v1.0).
This repository packages [MCP Toolbox](https://github.com/googleapis/mcp-toolbox)'s prebuilt `dataproc` server as a plugin/extension to interact with [Dataproc](https://cloud.google.com/dataproc) clusters and jobs. It can be used with various AI agents, including [Antigravity](https://antigravity.google/), [Claude Code](https://claude.com/product/claude-code) and [Codex](https://developers.openai.com/codex), to manage your clusters, monitor jobs, and troubleshoot issues using natural language prompts.
> [!IMPORTANT]
> **We Want Your Feedback!**
> Please share your thoughts with us by filling out our feedback [form][form].
> Your input is invaluable and helps us improve the project for everyone.
[form]: https://docs.google.com/forms/d/e/1FAIpQLSfEGmLR46iipyNTgwTmIDJqzkAwDPXxbocpXpUbHXydiN1RTw/viewform?usp=pp_url&entry.157487=dataproc
## Table of Contents
- [Why Use Dataproc?](#why-use-dataproc)
- [Prerequisites](#prerequisites)
- [Getting Started](#getting-started)
- [Configuration](#configuration)
- [Installation & Usage](#installation--usage)
- [Antigravity](#antigravity)
- [Claude Code](#claude-code)
- [Codex](#codex)
- [Installing via a compatible Agent Plugins client](#installing-via-a-compatible-agent-plugins-client)
- [Usage Examples](#usage-examples)
- [Available Tools](#available-tools)
- [Generating Skills Instead](#generating-skills-instead)
- [Troubleshooting](#troubleshooting)
## Why Use Dataproc?
- **Seamless Workflow:** Integrates seamlessly into your AI agent's environment. No need to constantly switch contexts for common Dataproc tasks.
- **Natural Language Queries:** Stop wrestling with complex gcloud commands. Manage your clusters and jobs by describing what you want in plain English.
- **Full Lifecycle Control:** Manage the entire lifecycle of your Dataproc resources, from listing clusters to checking job statuses.
## Prerequisites
Before you begin, ensure you have the following:
- One of these AI agents installed
- Antigravity
- [Antigravity CLI](https://github.com/google-gemini/gemini-cli) version **v1.6.0** or higher
- [Antigravity 2.0](https://antigravity.google/product/antigravity-2) version **v2.0.0** or higher.
- [Claude Code](https://claude.com/product/claude-code) version **v2.1.94** or higher.
- [Codex](https://developers.openai.com/codex) **v0.117.0** or higher.
- [Node.js](https://nodejs.org/) — the MCP server runs via `npx`.
- A Google Cloud project with the **Dataproc API** enabled.
- Ensure [Application Default Credentials](https://cloud.google.com/docs/authentication/gcloud) are available in your environment.
- IAM Permissions:
- Dataproc Viewer (`roles/dataproc.viewer`) or Dataproc Editor (`roles/dataproc.editor`)
## Getting Started
### Configuration
Please keep these env vars handy during the installation process:
- `DATAPROC_PROJECT`: The GCP project ID.
- `DATAPROC_REGION`: The region of your Dataproc resources.
> [!NOTE]
>
> - Ensure [Application Default Credentials](https://cloud.google.com/docs/authentication/gcloud) are available in your environment.
> - If your Cloud SQL for PostgreSQL instance uses private IPs, you must run your agent in the same Virtual Private Cloud (VPC) network.
### Installation & Usage
To start interacting with your database, install the extension for your preferred AI agent, then launch the agent and use natural language to ask questions or perform tasks.
For the latest version, check the [releases page][releases].
[releases]: https://github.com/gemini-cli-extensions/dataproc/releases
<!-- {x-release-please-start-version} -->
<details open>
<summary id="antigravity">Antigravity</summary>
You can use either of these two agents for Antigravity:
- [Antigravity CLI](https://github.com/google-gemini/gemini-cli) version **v1.6.0** or higher
- [Antigravity 2.0](https://antigravity.google/product/antigravity-2) version **v2.0.0** or higher.
<blockquote>
💡 <strong>Tip — Migrating from Gemini CLI?</strong><br>
If you previously installed this extension with <code>gemini extensions install</code>, you can convert it to an Antigravity plugin instead of reinstalling from scratch:
<ul>
<li><strong>On first launch of Antigravity CLI</strong>, accept the Migration Options prompt to automatically convert your installed Gemini CLI extensions to Antigravity plugins.</li>
<li><strong>Or, from your terminal</strong>, run:
<pre><code class="language-bash">agy plugin import gemini</code></pre>
</li>
</ul>
See <a href="https://antigravity.google/docs/gcli-migration">Migrating from Gemini CLI</a> for details on plugins, context files (<code>GEMINI.md</code> / <code>AGENTS.md</code>), and MCP server config differences.
</blockquote>
#### Antigravity 2.0 (IDE)
**1. Install the plugin:**
Install the plugin directly from the remote GitHub repository:
```bash
agy plugin install https://github.com/gemini-cli-extensions/dataproc
```
**2. Set env vars:**
Set your environment vars as described in the [configuration section](#configuration).
_(Tip: You can verify the MCP server is active by running the `/mcp` command in your active session.)_
#### Antigravity CLI
You can install plugins directly from a remote GitHub repository.
**1. Install the plugin:**
```bash
agy plugin install https://github.com/gemini-cli-extensions/dataproc
```
**2. Set env vars:**
Set your environment vars as described in the [configuration section](#configuration).
</details>
<details>
<summary id="claude-code">Claude Code</summary>
**1. Set env vars:**
In your terminal, set your environment vars as described in the [configuration section](#configuration).
**2. Start the agent:**
```bash
claude
```
**3. Install the plugin:**
```bash
/plugin install dataproc@claude-plugins-official
```
_(Tip: Run `/plugin list` inside Claude Code to verify the plugin is active, or `/reload-plugins` if you just installed it.)
</details>
<details>
<summary id="codex">Codex</summary>
**1. Install marketplace:**
```bash
codex plugin marketplace add GoogleCloudPlatform/data-cloud-plugins
```
**2. Install the plugin:**
```bash
codex plugin add dataproc@data-cloud-plugins
```
**3. Set env vars:**
Enter your environment vars as described in the [configuration section](#configuration).
**4. (Optional) Update the marketplace:**
```sh
codex plugin marketplace upgrade data-cloud-plugins
```
</details>
## Installing via a compatible Agent Plugins client
## Installing via a compatible Agent Plugins client
This repository is a valid [Agent Plugins](https://github.com/agentplugins/agent-plugins-spec) (v1) plugin. Any [Agent Plugins–compatible client](https://agent-plugins.org/compatible-clients) can install it directly using its own built-in plugin command — no extra tooling required — by pointing at this repository:
```
https://github.com/gemini-cli-extensions/dataproc
```
Beyond harnesses covered by the native install above, compatible clients include VS Code, Cursor, GitHub Copilot, and Kiro. See your agent's documentation for its exact install command.
**Set env vars:**
Set your environment vars as described in the [configuration section](#configuration).
<!-- {x-release-please-end} -->
## Usage Examples
Interact with Dataproc using natural language:
- **List Clusters:**
- "List all my Dataproc clusters in us-central1."
- **Check Jobs:**
- "Show me the status of the job with ID 'my-spark-job-123'."
- "List all failed jobs in my project."
- **Get Details:**
- "Get details for the cluster named 'my-cluster'."
## Available Tools
The tools come from MCP Toolbox's prebuilt `dataproc` server, grouped into toolsets:
- **dataproc_tools** - Skills to interact with your Dataproc clusters and jobs.
For the full, up-to-date list, see the [`dataproc` prebuilt config](https://github.com/googleapis/mcp-toolbox/blob/main/internal/prebuiltconfigs/tools/dataproc.yaml)
in the MCP Toolbox repository.
## Generating Skills Instead
The tool-backed skills this plugin used to ship were generated from the same prebuilt
toolsets. If your agent lacks deferred tool loading, or you prefer skills, regenerate
them with the script in this repository:
```bash
VERSION=<toolbox version> ./.github/scripts/generate_skills.sh
```
Use the toolbox version pinned in [`mcp.json`](./mcp.json). A single toolset, without
the script:
```bash
npx @toolbox-sdk/server@<toolbox version> --prebuilt dataproc skills-generate \
--name "<skill name>" \
--toolset "<toolset>" \
--description "<what it is for>"
```
The generated scripts call the toolbox through `npx`, so no binary download is needed.
See [Generate Agent Skills](https://github.com/googleapis/mcp-toolbox#generate-agent-skills)
in the MCP Toolbox repository.
## Troubleshooting
Use the debug mode of your agent (e.g., `gemini --debug`) to enable debugging.
Common issues:
- "failed to find default credentials": Ensure [Application Default Credentials](https://cloud.google.com/docs/authentication/gcloud) are available in your environment.
- "cannot execute binary file": The Toolbox binary did not download correctly.
© Google LLC · Apache-2.0 · GoogleCloudPlatform/dataproc-plugin