google-cloud-data-engineering-hub — Claude Code skill for GCP pipelines
A skill that hands your coding agent a reference set of working GCP data projects: BigQuery, Dataflow, Beam, Composer, Pub/Sub, Dataproc, Vertex AI.
npx skills add reason-machines/data-skills --skill google-cloud-data-engineering-hub -a claude-codeWhat google-cloud-data-engineering-hub does
This skill points the agent at a collection of runnable data engineering projects for Google Cloud. Each one ships as modular Python rather than loose scripts, with ASCII architecture diagrams, sample fixtures and a deploy.sh that automates the GCP setup. The examples were run against live cloud projects.
Coverage is grouped by service. BigQuery entries handle CSV ingestion, the UPSERT/MERGE pattern, and training plus prediction with BigQuery ML. Storage projects cover file operations and v4 signed URLs with lifecycle rules. Further out you get Dataflow and Apache Beam jobs, Cloud Composer workflows, Dataproc Serverless, Pub/Sub streaming, and pipelines wired to Gemini AI and Vertex AI.
Before you start: Python 3.10 or newer, the gcloud CLI, a GCP project with billing turned on, and the right IAM permissions. No billing-enabled project means nothing runs, so check that first. Dependencies are installed per project from its own requirements.txt, and credentials come from gcloud auth application-default login.
What it helps with
- load a CSV file into BigQuery
- write a MERGE statement for upserts
- train and query a BigQuery ML model
- stream records through Pub/Sub
- run a workflow in Cloud Composer
Example prompts for the agent
- Build a BigQuery pipeline that loads a CSV file
- Show me how to upsert rows in BigQuery with MERGE
- Set up Pub/Sub streaming into Dataflow
How to install google-cloud-data-engineering-hub
1Skills CLI (Vercel)
npx skills add reason-machines/data-skills --skill google-cloud-data-engineering-hub -a claude-code2Manually: put the files in place
~/.claude/skills/google-cloud-data-engineering-hub/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/google-cloud-data-engineering-hub/
1Skills CLI (Vercel)
npx skills add reason-machines/data-skills --skill google-cloud-data-engineering-hub -a codex2Manually: put the files in place
.agents/skills/google-cloud-data-engineering-hub/SKILL.mdFor all projects use ~/.agents/skills/
1Skills CLI (Vercel)
npx skills add reason-machines/data-skills --skill google-cloud-data-engineering-hub -a cursor2Manually: put the files in place
.cursor/skills/google-cloud-data-engineering-hub/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install reason-machines/data-skills google-cloud-data-engineering-hub2Manually: put the files in place
.github/skills/google-cloud-data-engineering-hub/SKILL.md1Skills CLI (Vercel)
npx skills add reason-machines/data-skills --skill google-cloud-data-engineering-hub -a gemini-cli2Platform CLI
gemini skills install https://github.com/reason-machines/data-skills --path skills/google-cloud-data-engineering-hubManually: put the files in place
.devin/skills/google-cloud-data-engineering-hub/SKILL.mdThe legacy .windsurf/skills/ path still works
Skills CLI (Vercel)
npx skills add reason-machines/data-skills --skill google-cloud-data-engineering-hub -a opencodeClaude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
Step by step, with commands for each platform: How to install skills in Claude Code: five ways
Questions about google-cloud-data-engineering-hub
How do I install google-cloud-data-engineering-hub in Claude Code?
Run npx skills add reason-machines/data-skills --skill google-cloud-data-engineering-hub -a claude-code. The skill file lands at ~/.claude/skills/google-cloud-data-engineering-hub/SKILL.md.
What does google-cloud-data-engineering-hub do?
It gives the agent a reference library of GCP data engineering projects covering BigQuery, Dataflow, Apache Beam, Cloud Composer, Pub/Sub, Dataproc, Gemini AI and Vertex AI.
What do I need before using it?
Python 3.10+, the gcloud CLI, and a GCP project with billing enabled and suitable IAM permissions. Install each project's dependencies from its own requirements.txt.