Skip to main content
skill CX Codex

pipeline-assistant — Claude Code skill: what it does, how to install

pipeline-assistant is a Claude Code skill for generating and repairing Redpanda Connect pipeline YAML, validating configurations with rpk connect lint, and testing pipelines.

no license 1 installs ★ 8,804 updated 2026-10-29

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add redpanda-data/connect --skill pipeline-assistant -a claude-code
Open on GitHub

What pipeline-assistant does

The skill coordinates Redpanda Connect pipeline setup from scratch or fixes broken files. It bootstraps templates using rpk connect create, checks structure with rpk connect lint, and runs local integration checks via rpk connect run. Local pipeline verification supports standard input and output streams. This method cannot verify batching limits or connection timeouts against live backends.

Pipeline discovery delegates to component-search, while transformation logic relies on bloblang-authoring. Without rpk and rpk connect installed in your environment, validation and execution tools fail immediately.

What it helps with

  • scaffold Redpanda Connect YAML pipelines from component lists using rpk connect create
  • detect schema and Bloblang errors in pipeline configurations using rpk connect lint
  • verify message routing rules and transformations locally with stdin and stdout
  • inject credentials and environment parameters securely using --env-file
  • troubleshoot streaming failures with debug logging via rpk connect run

Example prompts for the agent

  • Generate a Redpanda Connect config that reads from Kafka topic events and writes to stdout
  • Validate my existing pipeline in pipeline.yaml using secrets from .env
  • Fix the routing errors in connect.yaml and run a test pass with debug logs

How to install pipeline-assistant

1Skills CLI (Vercel)

npx skills add redpanda-data/connect --skill pipeline-assistant -a claude-code

2Manually: put the files in place

~/.claude/skills/pipeline-assistant/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/pipeline-assistant/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about pipeline-assistant

How to install pipeline-assistant in Claude Code?

Run npx skills add redpanda-data/connect --skill pipeline-assistant -a claude-code.

What does pipeline-assistant do?

It creates, validates, and troubleshoots Redpanda Connect streaming pipeline configurations in YAML.

What external dependencies does pipeline-assistant require?

The skill requires local installations of rpk and rpk connect, as well as access to component-search and bloblang-authoring skills.

Similar skills

All skills for Data and databases →
data-pipeline Seth Hobson data-pipeline is a Claude Code command that designs and builds batch and streaming data pipelines. It covers ingestion, transformations, quality checks, and monitoring. CX Codex +1 ★ 42,780repo stars data-pipeline-engineer curiositech data-pipeline-engineer guides data pipeline design, Medallion storage layers, Airflow DAG orchestration, and dbt models. Activates for batch processing and streaming workloads. CX Codex +1 215installs managing-amazon-msk aws managing-amazon-msk is a Claude Code skill that operates Amazon MSK Provisioned clusters with Standard or Express brokers. It assists during consumer lag spikes, capacity planning, and live migrations. CX Codex +1 5,900installs mongodb-atlas-stream-processing mongodb Skill for Claude Code, Codex, Cursor and other platforms manages streaming pipelines in MongoDB Atlas Stream Processing. Creates workspaces, connects data sources and sinks (Kafka, S3, Lambda), starts and stops processors, diagnoses errors. CX Codex +1 4,100installs realtime-cinema-data-engineering-pipeline reason-machines realtime-cinema-data-engineering-pipeline is a Claude Code skill for assembling a streaming pipeline that routes simulated cinema ticket transactions through message queues and warehouse layers. CX Codex +1 2,000installs retail-etl-medallion-pipeline reason-machines retail-etl-medallion-pipeline is a Claude Code skill that builds a Bronze/Silver/Gold ETL pipeline for retail data warehousing. CX Codex +1 1,800installs

From the same set2

Project sponsors

Companies that keep this analytics open