Skip to main content
skill CX Codex

google-cloud-data-engineering-hub — Claude Code skill for GCP pipelines

A skill that hands your coding agent a reference set of working GCP data projects: BigQuery, Dataflow, Beam, Composer, Pub/Sub, Dataproc, Vertex AI.

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add reason-machines/data-skills --skill google-cloud-data-engineering-hub -a claude-code
Open on GitHub

What google-cloud-data-engineering-hub does

This skill points the agent at a collection of runnable data engineering projects for Google Cloud. Each one ships as modular Python rather than loose scripts, with ASCII architecture diagrams, sample fixtures and a deploy.sh that automates the GCP setup. The examples were run against live cloud projects.

Coverage is grouped by service. BigQuery entries handle CSV ingestion, the UPSERT/MERGE pattern, and training plus prediction with BigQuery ML. Storage projects cover file operations and v4 signed URLs with lifecycle rules. Further out you get Dataflow and Apache Beam jobs, Cloud Composer workflows, Dataproc Serverless, Pub/Sub streaming, and pipelines wired to Gemini AI and Vertex AI.

Before you start: Python 3.10 or newer, the gcloud CLI, a GCP project with billing turned on, and the right IAM permissions. No billing-enabled project means nothing runs, so check that first. Dependencies are installed per project from its own requirements.txt, and credentials come from gcloud auth application-default login.

What it helps with

  • load a CSV file into BigQuery
  • write a MERGE statement for upserts
  • train and query a BigQuery ML model
  • stream records through Pub/Sub
  • run a workflow in Cloud Composer

Example prompts for the agent

  • Build a BigQuery pipeline that loads a CSV file
  • Show me how to upsert rows in BigQuery with MERGE
  • Set up Pub/Sub streaming into Dataflow

How to install google-cloud-data-engineering-hub

1Skills CLI (Vercel)

npx skills add reason-machines/data-skills --skill google-cloud-data-engineering-hub -a claude-code

2Manually: put the files in place

~/.claude/skills/google-cloud-data-engineering-hub/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/google-cloud-data-engineering-hub/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about google-cloud-data-engineering-hub

How do I install google-cloud-data-engineering-hub in Claude Code?

Run npx skills add reason-machines/data-skills --skill google-cloud-data-engineering-hub -a claude-code. The skill file lands at ~/.claude/skills/google-cloud-data-engineering-hub/SKILL.md.

What does google-cloud-data-engineering-hub do?

It gives the agent a reference library of GCP data engineering projects covering BigQuery, Dataflow, Apache Beam, Cloud Composer, Pub/Sub, Dataproc, Gemini AI and Vertex AI.

What do I need before using it?

Python 3.10+, the gcloud CLI, and a GCP project with billing enabled and suitable IAM permissions. Install each project's dependencies from its own requirements.txt.

Similar skills

All skills for Cloud: AWS, Azure, GCP →

From the same set31

terraform-data-engineering-infrastructure A skill with Terraform patterns for data engineering: S3 data lake buckets, EC2 processing nodes, IAM roles. Useful when AWS infrastructure has to be described in code, not clicked together. CX Codex +1 1,800installs harvard-artifacts-etl-pipeline A skill that walks your coding agent through an ETL pipeline from the Harvard Art Museums API to Streamlit charts. CX Codex +1 1,700installs data-analytics-skills-claude A collection of analytics skills for checking data, investigating metrics, and shaping dashboard specs. Use it when an analysis needs a clear workflow and shareable results. CX Codex +1 1,300installs harvard-art-museum-data-engineering A skill that builds an ETL pipeline for the Harvard Art Museums API: pull artifacts, shape them into tables, load into SQL, and chart them in Streamlit. CX Codex +1 1,300installs harvard-art-museums-data-engineering A skill for building ETL pipelines on Harvard Art Museums API data: normalise into MySQL, run SQL analytics, ship a Streamlit dashboard. CX Codex +1 843installs bigquery-agent-analytics-sdk A skill for analyzing AI agent telemetry in BigQuery: trace reconstruction, LLM-as-Judge evaluation, and drift detection. CX Codex +1 768installs power-bi-salespulse-360-dashboard A skill that walks your agent through building the SalesPulse 360 retail dashboard in Power BI: sales, profit, regions and a 12-month forecast. CX Codex +1 656installs telegram-group-analytics-bot This skill tracks Telegram group activity: member growth, message counts, hourly heatmaps and scheduled reports you can export. CX Codex +1 610installs

Project sponsors

Companies that keep this analytics open
Gold sponsor

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor