Skip to main content
skill CX Codex

executing-spark — Claude Code skill for running PySpark in Fabric

executing-spark is a Claude Code skill that runs Python or PySpark on Fabric Spark through Livy without creating a notebook. It supports temporary transformations and lakehouse table queries.

GPL-3.0 ★ 1,104 updated 2026-10-28

Install into Claude Code · Plugin marketplace All methods and platforms ↓
/plugin marketplace add data-goblin/power-bi-agentic-development
/plugin install etl@power-bi-agentic-development
Open on GitHub

What executing-spark does

The skill opens a Livy session, sends code to it, and returns the execution result. The session can use spark.sql, Delta tables, and regular Python; multiple statements can run before it closes. No notebook is saved.

You need Azure CLI authentication with az login, a lakehouse in the target workspace, and Fabric capacity on F or trial. Get the token with az account get-access-token --resource https://api.fabric.microsoft.com; a fab auth token cannot access OneLake from the Spark session. Close the session when the work is done, since an idle one still uses Fabric capacity units.

What it helps with

  • run PySpark on Fabric without creating a notebook
  • query lakehouse tables with Spark SQL
  • write transformed data to a Delta table
  • execute several statements in one Livy session

Example prompts for the agent

  • Run this PySpark code on Fabric through Livy without creating a notebook.
  • Query the lakehouse tables with spark.sql and show the result.
  • Transform the data in Spark, write it to a Delta table, then close the session.

How to install executing-spark

1Plugin marketplace

/plugin marketplace add data-goblin/power-bi-agentic-development
/plugin install etl@power-bi-agentic-development

This installs the whole etl plugin with all its skills

2Skills CLI (Vercel)

npx skills add data-goblin/power-bi-agentic-development --skill executing-spark -a claude-code

3Manually: put the files in place

~/.claude/skills/executing-spark/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/executing-spark/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about executing-spark

How do I install executing-spark in Claude Code?

Add the marketplace with /plugin marketplace add data-goblin/power-bi-agentic-development, then install the plugin with /plugin install etl@power-bi-agentic-development.

What does executing-spark do?

It sends Python or PySpark to Fabric compute through Livy and returns the result without saving a notebook. The code can read and write lakehouse tables.

What does the skill need to run?

Authenticate Azure CLI with az login, and provide a lakehouse in the target workspace plus Fabric capacity on F or trial. OneLake access needs a token from az account get-access-token; fab auth tokens do not work for that access.

Similar skills

All skills for Data and databases →
sql-jdbc-access-design Samuel Berthe sql-jdbc-access-design designs how a product exposes its data to customers over live SQL: a JDBC/ODBC endpoint, a warehouse share, or a hosted query surface. Use it before the first customer connects. CX Codex +1 10,100installs powerbi-modeling official github The powerbi-modeling skill helps build and review Power BI semantic models, write DAX, and configure relationships. Use it when the model includes RLS or complex calculations. CX Codex +1 9,934installs power-bi-report-design-consultation official github The power-bi-report-design-consultation skill guides Power BI report planning, from chart choices to page layout and accessibility. Use it when a report needs to support specific decisions for a defined audience. CX Codex +1 9,390installs power-bi-build gasserane power-bi-build scaffolds IPPF-branded Power BI projects and writes DAX measures directly to .pbip models. Requires Power BI Desktop and the pbi CLI. CX Codex +1 688installs power-bi-salespulse-360-dashboard reason-machines power-bi-salespulse-360-dashboard is a Claude Code skill for configuring the SalesPulse 360 Power BI dashboard. It activates for retail sales and profit analysis, regional reporting, forecasting, and alert setup. CX Codex +1 661installs logifleet-pulse-supply-chain-analytics reason-machines logifleet-pulse-supply-chain-analytics is a Claude Code skill for planning logistics analytics with MS SQL Server and Power BI. It activates on requests about warehouse and fleet models, reports, or optimization. CX Codex +1 659installs

From the same set59

The whole set →
using-duckdb Query Delta tables and raw files in Fabric OneLake using DuckDB either on your machine or inside a Fabric notebook. CX Codex +1 ★ 1,104repo stars powerbi-custom-visuals powerbi-custom-visuals is a Claude Code skill for building interactive Power BI visuals with the pbiviz toolchain, from project setup through packaging and certification prep. It supports visuals reused across reports. CX Codex +1 ★ 1,104repo stars fabric-capacity fabric-capacity — a skill that tracks utilization of Microsoft Fabric capacities in real time, identifies which workloads consume CU, and manages capacity state through the API. CX Codex +1 ★ 1,104repo stars te-docs te-docs enables documentation searches for Tabular Editor and guides configuration of TE3 settings files. CX Codex +1 ★ 1,104repo stars modifying-theme-json modifying-theme-json manages Power BI report themes via the pbir CLI: creates themes, changes palette and fonts, promotes visual formatting into the theme, clears local overrides. CX Codex +1 ★ 1,104repo stars creating-good-dashboards creating-good-dashboards enforces visual clarity and comment protocols when building or styling Claude dashboards, applying principles from Edward Tufte, Stephen Few, and Ben Shneiderman. CX Codex +1 ★ 1,104repo stars te2-cli The te2-cli skill helps Claude Code work with Tabular Editor 2 from the command line, from running scripts to checking and deploying models. Use it when automating Power BI model tasks. CX Codex +1 ★ 1,104repo stars python-visuals This skill guides an agent through adding Python visuals to PBIR Power BI reports and writing the matplotlib or seaborn scripts behind them. CX Codex +1 ★ 1,104repo stars

Project sponsors

Companies that keep this analytics open