Skip to main content
skill CX Codex

harvard-art-museums-data-engineering-pipeline — Claude Code skill

A skill for building an ETL pipeline on Harvard Art Museums API data: JSON into normalized SQL tables, analytical queries, and a Streamlit dashboard.

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add reason-machines/data-skills --skill harvard-art-museums-data-engineering-pipeline -a claude-code
Open on GitHub

What harvard-art-museums-data-engineering-pipeline does

The skill walks through the whole chain, from a Harvard Art Museums API request to an interactive dashboard. Records are pulled page by page with rate limiting in mind, then the nested JSON is split into normalized tables: object metadata, images, and colors each get their own table, joined by objectid. The schema is created during the load step.

Code samples are Python. requests handles fetching, pandas does the reshaping, mysql-connector-python writes to the database, and plotly plus streamlit cover the visuals. Analytics rest on a set of ready-made SQL queries against the loaded tables.

You need a Harvard Art Museums API key and a MySQL or TiDB Cloud database before anything runs. Credentials live in .env: HARVARD_API_KEY, DB_HOST, DB_PORT, DB_USER, DB_PASSWORD, DB_NAME. Leave that file empty and both the fetch and the load fail. The dashboard starts with streamlit run app.py and serves at http://localhost:8501.

What it helps with

  • pull objects from the Harvard Art Museums API across pages
  • flatten nested JSON into normalized SQL tables
  • design a relational schema with foreign keys for a collection
  • write analytical SQL queries over the collected data
  • put together a Streamlit dashboard with Plotly charts

Example prompts for the agent

  • Build an ETL pipeline that pulls objects from the Harvard Art Museums API into MySQL
  • Set up a normalized schema for object metadata, images, and colors
  • Create a Streamlit dashboard with Plotly charts for the collection data

How to install harvard-art-museums-data-engineering-pipeline

1Skills CLI (Vercel)

npx skills add reason-machines/data-skills --skill harvard-art-museums-data-engineering-pipeline -a claude-code

2Manually: put the files in place

~/.claude/skills/harvard-art-museums-data-engineering-pipeline/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/harvard-art-museums-data-engineering-pipeline/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about harvard-art-museums-data-engineering-pipeline

How do I install harvard-art-museums-data-engineering-pipeline in Claude Code?

Run npx skills add reason-machines/data-skills --skill harvard-art-museums-data-engineering-pipeline -a claude-code. The skill lands at ~/.claude/skills/harvard-art-museums-data-engineering-pipeline/SKILL.md.

What does harvard-art-museums-data-engineering-pipeline do?

It guides you through an end-to-end pipeline: fetching from the Harvard Art Museums API, reshaping JSON into normalized tables, loading SQL, and a Streamlit dashboard with Plotly charts.

What do I need before running it?

A Harvard Art Museums API key and a MySQL or TiDB Cloud database. The key and connection settings go into .env.

Similar skills

All skills for Data and databases →

From the same set31

harvard-artifacts-collection-data-engineering This skill pulls Harvard Art Museums data into MySQL and renders it in Streamlit. Useful when you want a working ETL example from API to dashboard. CX Codex +1 1,900installs harvard-artifacts-etl-streamlit-analytics Walks your agent through building an ETL pipeline and an analytics dashboard on Harvard Art Museums API data with Python, SQL and Streamlit. CX Codex +1 1,900installs harvard-artifacts-collection-etl-analytics A skill for building an ETL pipeline and analytics dashboard on Harvard Art Museums API data with Python, SQL and Streamlit. CX Codex +1 1,900installs harvard-artifacts-collection-analytics-pipeline A skill that walks your agent through a full Harvard Art Museums API pipeline: ETL, SQL storage and a Streamlit dashboard. CX Codex +1 1,900installs iac-terraform-data-engineering A skill for Claude and other AI agents that helps describe AWS data infrastructure in Terraform: S3 buckets, EC2 instances, IAM roles. CX Codex +1 1,800installs iac-data-engineering-terraform A skill with ready Terraform patterns for data engineering: S3 buckets, EC2 instances and IAM roles. Useful when you need to stand up pipeline infrastructure declaratively. CX Codex +1 1,800installs terraform-data-engineering-infrastructure A skill with Terraform patterns for data engineering: S3 data lake buckets, EC2 processing nodes, IAM roles. Useful when AWS infrastructure has to be described in code, not clicked together. CX Codex +1 1,800installs harvard-artifacts-etl-pipeline A skill that walks your coding agent through an ETL pipeline from the Harvard Art Museums API to Streamlit charts. CX Codex +1 1,700installs

Project sponsors

Companies that keep this analytics open
Gold sponsor

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor