Skip to main content
skill CX Codex

fabric-onelake-2025 — Claude Code skill: ADF and Microsoft Fabric

fabric-onelake-2025 — a Claude skill for wiring Azure Data Factory to Microsoft Fabric: Lakehouse and Warehouse connectors, OneLake shortcuts, pipeline calls both ways.

MIT 161 installs ★ 66 updated 2026-06-18

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add JosiahSiegel/claude-plugin-marketplace --skill fabric-onelake-2025 -a claude-code
Open on GitHub

What fabric-onelake-2025 does

The skill covers Azure Data Factory against Microsoft Fabric: Lakehouse and Warehouse connectors, OneLake shortcuts, and pipeline calls in either direction. It documents linked service types (Lakehouse, Warehouse), which activities each one supports, and JSON samples kept in references/lakehouse-examples.md, references/warehouse-examples.md and references/onelake-patterns.md.

Auth runs through the ADF managed identity, which the skill prefers, or a service principal. A Lakehouse linked service needs workspaceId and artifactId; writes land via LakehouseTableSink or LakehouseFileSink using append or overwrite. Warehouse takes endpoint and warehouse, insert or upsert, plus tableOption: "autoCreate" for tables that don't exist yet.

Role assignments in Fabric need time to propagate. Give the ADF identity Contributor, wait about 5 minutes, then run the pipeline — otherwise the first copy fails on permission. Warehouse access is separate: create the SQL user with CREATE USER ... FROM EXTERNAL PROVIDER and add it to db_datareader and db_datawriter.

What it helps with

  • wire a Fabric Lakehouse into ADF and copy tables or files
  • grant the ADF managed identity Contributor access to a Fabric workspace
  • swap an ADLS Gen2 copy for a zero-copy OneLake shortcut
  • call a Fabric pipeline from ADF and pass parameters across platforms
  • set up upsert and autoCreate writes into a Fabric Warehouse

Example prompts for the agent

  • Set up a Lakehouse linked service in ADF for the workspace ws-fabric-prod and take the artifact ID from the Lakehouse settings.
  • Replace the ADLS Gen2 copy with a OneLake shortcut so the data stays where it is.
  • Add an Invoke Pipeline activity that starts a Fabric pipeline and passes the run date as a parameter.

How to install fabric-onelake-2025

1Skills CLI (Vercel)

npx skills add JosiahSiegel/claude-plugin-marketplace --skill fabric-onelake-2025 -a claude-code

2Manually: put the files in place

~/.claude/skills/fabric-onelake-2025/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/fabric-onelake-2025/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about fabric-onelake-2025

How do I install fabric-onelake-2025 in Claude Code?

Run npx skills add JosiahSiegel/claude-plugin-marketplace --skill fabric-onelake-2025 -a claude-code. The skill file lands at ~/.claude/skills/fabric-onelake-2025/SKILL.md.

What does fabric-onelake-2025 do?

It walks through connecting ADF to Fabric Lakehouse and Warehouse, OneLake shortcut patterns, cross-platform pipeline calls, and the permissions behind them, with JSON samples for each case.

Do I need a service principal for ADF to reach Fabric?

No. Managed identity is the preferred route: system-assigned for a single factory, user-assigned when several need the same access. A service principal with a Key Vault secret works too.

Source text

SKILL.md · MIT
---
name: fabric-onelake-2025
description: |
  ADF + Microsoft Fabric / OneLake 2025 integration.
  PROACTIVELY activate for: (1) Fabric Lakehouse connector in ADF, (2) Fabric Warehouse connector in ADF, (3) OneLake shortcuts and cross-workspace data, (4) Invoke Pipeline activity for cross-platform orchestration (ADF -> Fabric, Fabric -> ADF), (5) copying data between ADF and Microsoft Fabric workspaces, (6) authenticating with Fabric workspace identity, (7) cross-platform parameter passing, (8) hybrid ADF + Fabric pipeline patterns.
  Provides: Fabric connector setup, Invoke Pipeline templates, OneLake shortcut patterns, and ADF-to-Fabric migration guidance.
---

# Microsoft Fabric Integration with Azure Data Factory (2025)

## Overview

Microsoft Fabric is a unified SaaS analytics platform combining Power BI, Azure Synapse Analytics, and Azure Data Factory capabilities. ADF provides native connectors for Fabric Lakehouse and Fabric Warehouse, enabling seamless data movement between ADF and Fabric workspaces.

## Microsoft Fabric Lakehouse Connector

The Fabric Lakehouse connector enables read and write operations to Microsoft Fabric Lakehouse for tables and files.

### Supported Activities

| Activity | Supported |
|----------|-----------|
| Copy Activity (source and sink) | Yes |
| Lookup Activity | Yes |
| Get Metadata Activity | Yes |
| Delete Activity | Yes |

### Quick Reference

- **Linked service type:** `Lakehouse`
- **Authentication:** Managed Identity (preferred) or Service Principal
- **Required IDs:** `workspaceId` and `artifactId`
- **Sink types:** `LakehouseTableSink` (tables), `LakehouseFileSink` (files)
- **Source type:** `LakehouseTableSource`
- **Table action options:** `append` or `overwrite`

**Finding Workspace and Artifact IDs:**
1. Navigate to Fabric workspace in browser
2. Copy workspace ID from URL: `https://app.powerbi.com/groups/<workspaceId>/...`
3. Open Lakehouse settings to find artifact ID
4. Or use Fabric REST API to enumerate workspace items

For complete linked service, dataset, and copy activity JSON examples, see `references/lakehouse-examples.md`.

## Microsoft Fabric Warehouse Connector

The Fabric Warehouse connector provides T-SQL based data warehousing capabilities within the Fabric ecosystem.

### Supported Activities

| Activity | Supported |
|----------|-----------|
| Copy Activity (source and sink) | Yes |
| Lookup Activity | Yes |
| Get Metadata Activity | Yes |
| Script Activity | Yes |
| Stored Procedure Activity | Yes |

### Quick Reference

- **Linked service type:** `Warehouse`
- **Authentication:** System-Assigned Managed Identity (recommended), User-Assigned MI, or Service Principal
- **Required properties:** `endpoint`, `warehouse`
- **Sink type:** `WarehouseSink`
- **Write behaviors:** `insert` or `upsert`
- **Table option:** `autoCreate` (creates table if missing)

For complete linked service, copy activity, stored procedure, and script activity JSON examples, see `references/warehouse-examples.md`.

## OneLake Integration Patterns

ADF supports three integration patterns with OneLake:

| Pattern | Description | Key Benefit |
|---------|-------------|-------------|
| ADLS Gen2 Shortcuts | Reference ADLS data via OneLake shortcuts (zero-copy) | No data duplication |
| Incremental Load | Watermark-based incremental copy to Lakehouse | Efficient updates |
| Cross-Platform Invoke | Use InvokePipeline activity to call Fabric pipelines | Hybrid orchestration |

**OneLake Shortcuts** are the preferred approach when data already exists in ADLS Gen2 -- they provide instant zero-copy access without data movement. Use ADF Copy Activity only when data transformation or format conversion is needed.

For complete pipeline JSON examples for all three patterns, see `references/onelake-patterns.md`.

## Permission Configuration

### Azure Data Factory Managed Identity Permissions in Fabric

**For Fabric Lakehouse:**
1. Open Fabric workspace
2. Go to Workspace settings -> Manage access
3. Add ADF managed identity with **Contributor** role
4. Or assign **Workspace Admin** for full access

**For Fabric Warehouse:**
1. Navigate to Warehouse SQL endpoint
2. Execute SQL to create user:
```sql
CREATE USER [your-adf-name] FROM EXTERNAL PROVIDER;
ALTER ROLE db_datareader ADD MEMBER [your-adf-name];
ALTER ROLE db_datawriter ADD MEMBER [your-adf-name];
```

### Service Principal Permissions

**App Registration Setup:**
1. Register app in Microsoft Entra ID
2. Create client secret (store in Key Vault)
3. Add app to Fabric workspace with Contributor role
4. For Warehouse, create SQL user as shown above

## Best Practices (2025)

1. **Use Managed Identity** -- System-assigned for single ADF, user-assigned for multiple. Avoid service principal keys when possible. Store any secrets in Key Vault.

2. **Enable Staging for Large Loads** -- Use staging with compression for data volumes > 1 GB, complex transformations, or Fabric Warehouse loads.

3. **Leverage OneLake Shortcuts** -- Use `ADLS Gen2 -> OneLake Shortcut -> Direct Access` instead of `ADLS Gen2 -> Copy Activity -> Lakehouse`. No data movement, instant availability, reduced costs.

4. **Monitor Fabric Capacity Units (CU)** -- Track CU consumption per pipeline run, peak usage, and throttling. Optimize with incremental loads, off-peak scheduling, and right-sized parallelism.

5. **Use Table Option AutoCreate** -- Set `tableOption: "autoCreate"` on WarehouseSink for automatic schema management and faster development.

6. **Implement Error Handling** -- Configure retry policies on Copy activities and add WebActivity-based failure logging with `dependencyConditions: ["Failed"]`.

## Common Issues and Solutions

| Issue | Error Message | Solution |
|-------|--------------|----------|
| Permission Denied | "User does not have permission to access Fabric workspace" | Add ADF managed identity as Contributor; for Warehouse, create SQL user; allow 5 min propagation |
| Endpoint Not Found | "Unable to connect to endpoint" | Verify workspaceId/artifactId; check workspace URL; ensure Lakehouse/Warehouse is not paused |
| Schema Mismatch | "Column types do not match" | Use `tableOption: "autoCreate"` or explicit column mappings in translator |
| Performance Degradation | Slow copy performance | Enable staging, increase parallelCopies (4-8), increase DIUs (8-32), check CU throttling |

## Resources

- [Fabric Lakehouse Connector](https://learn.microsoft.com/azure/data-factory/connector-microsoft-fabric-lakehouse)
- [Fabric Warehouse Connector](https://learn.microsoft.com/azure/data-factory/connector-microsoft-fabric-warehouse)
- [OneLake Documentation](https://learn.microsoft.com/fabric/onelake/)
- [Fabric Capacity Management](https://learn.microsoft.com/fabric/enterprise/licenses)
- [ADF to Fabric Integration Guide](https://learn.microsoft.com/fabric/data-factory/how-to-ingest-data-into-fabric-from-azure-data-factory)

## Progressive Disclosure References

- **Lakehouse Examples**: `references/lakehouse-examples.md` - Complete linked service, dataset, copy activity, and lookup JSON examples
- **Warehouse Examples**: `references/warehouse-examples.md` - Complete linked service, copy activity, stored procedure, and script activity JSON examples
- **OneLake Patterns**: `references/onelake-patterns.md` - Pipeline patterns for shortcuts, incremental loads, and cross-platform Invoke Pipeline

© JosiahSiegel · MIT · JosiahSiegel/claude-plugin-marketplace

Similar skills

All skills for Data and databases →

From the same set96

The whole set →
docker-git-bash-guide docker-git-bash-guide fixes Docker volume mount path mangling in Windows Git Bash and MINGW environments using proven environment variable workarounds. CX Codex +1 163installs string-manipulation-mastery string-manipulation-mastery is a Claude Code skill for editing and parsing Bash strings. It activates for parameter expansion, regex checks, array splitting, and whitespace trimming. CX Codex +1 163installs git-2-49-features git-2-49-features loads Git 2.49 context into your agent: the new git backfill, path-walk packing, zlib-ng compression. Useful when a repo moves to the new release. CX Codex +1 161installs process-substitution-fifos This skill helps agents build Bash data flows with process substitution, FIFOs, and coprocesses. Use it when streams must move between processes without temporary files. CX Codex +1 161installs aks-automatic-2025 aks-automatic-2025 — a skill for working with Azure Kubernetes Service in Automatic mode. Adds knowledge of Karpenter, autoscaling, workload identity, and 2025 cluster defaults. CX Codex +1 161installs ado-windows-git-bash-compatibility ado-windows-git-bash-compatibility — a skill for Claude and other agents that untangles Azure Pipelines failures on Windows agents: MINGW path conversion, shell task choice, CRLF in checked-in scripts. CX Codex +1 159installs azure-emulators-2025 azure-emulators-2025 sets up local Azure Docker emulators including Azurite, Cosmos DB, and SQL Server 2025. Useful for integration testing without live cloud subscriptions. CX Codex +1 159installs advanced-features-2025 The advanced-features-2025 skill covers plugin hooks, MCP setup, and repository-level team distribution. Use it when building or configuring Claude Code plugins for a team. CX Codex +1 159installs

Project sponsors

Companies that keep this analytics open