Skip to main content
affpapa.org
RU EN
skill CX Codex

harvard-artifacts-collection-analytics-pipeline — Claude Code skill

A skill that walks your agent through a full Harvard Art Museums API pipeline: ETL, SQL storage and a Streamlit dashboard.

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓ 
npx skills add reason-machines/data-skills --skill harvard-artifacts-collection-analytics-pipeline -a claude-code
Open on GitHub

What harvard-artifacts-collection-analytics-pipeline does

The skill drives a project along one path: API → ETL → SQL → analytics → visualization. You supply a Harvard Art Museums API key, and the agent writes the extraction code, reshapes the JSON into metadata, media and color tables, then loads them into MySQL or TiDB Cloud. Three tables carry the data — artifactmetadata, artifactmedia, artifactcolors — joined on artifact_id.

Inside are Python building blocks: requests with a pause between pages so the API rate limit does not bite, pandas for the transform, mysql-connector-python for the connection, plus plotly and streamlit for the dashboard. Fetching is paginated and limited to objects that have images.

Before anything runs you need a .env file with HARVARD_API_KEY and the database settings: DB_HOST, DB_PORT, DB_USER, DB_PASSWORD, DB_NAME. No working MySQL or TiDB Cloud connection means the pipeline stalls at the load step, because there is nowhere to write the tables. Dependencies come from requirements.txt.

What it helps with

  • pull artifact metadata from the Harvard Art Museums API page by page
  • split nested JSON into metadata, media and color tables
  • load the transformed rows into MySQL or TiDB Cloud
  • write analytical SQL over the collection
  • build an interactive Streamlit dashboard with Plotly charts

Example prompts for the agent

  • build an ETL pipeline for the Harvard Art Museums API: extract, transform and load into MySQL
  • add SQL queries to analyze the collection by culture and technique
  • create a Streamlit dashboard visualizing colors and departments

How to install harvard-artifacts-collection-analytics-pipeline

1Skills CLI (Vercel)

npx skills add reason-machines/data-skills --skill harvard-artifacts-collection-analytics-pipeline -a claude-code

2Manually: put the files in place

~/.claude/skills/harvard-artifacts-collection-analytics-pipeline/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/harvard-artifacts-collection-analytics-pipeline/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about harvard-artifacts-collection-analytics-pipeline

How do I install harvard-artifacts-collection-analytics-pipeline in Claude?

Run npx skills add reason-machines/data-skills --skill harvard-artifacts-collection-analytics-pipeline -a claude-code. The skill lands at ~/.claude/skills/harvard-artifacts-collection-analytics-pipeline/SKILL.md.

What does this skill do?

It takes the agent through the whole Harvard Art Museums data cycle: fetching objects from the API, reshaping JSON into tables, loading them into a SQL database and building a Streamlit dashboard.

What do I need before running it?

A HARVARD_API_KEY and access to MySQL or TiDB Cloud — host, port, user, password and database name in .env. Dependencies install from requirements.txt.

Similar skills

All skills for Data and databases →
polars K-Dense-AI The skill gives agents reference material on Polars, the Python DataFrame library with lazy evaluation and an expression-based API for ETL and pandas migration. CX Codex +1 2,000installs data-pipeline claude-office-skills A skill for building ETL pipelines: extract from APIs and databases, transform, then load into warehouses and sheets. Useful when data from several sources has to land in one place on a schedule. CX Codex +1 4,900installs ETL Pipeline Claude Office Skills A skill for designing and automating ETL pipelines: pull from databases and APIs, transform, load into warehouses. Useful when you need a recurring data flow. CX Codex +1 4,800installs sql-pro https://github.com/Jeffallan Optimizes slow SQL queries, designs database schemas, and fixes performance bottlenecks. Built for EXPLAIN plan tuning and cross-dialect migrations. CX Codex +1 6,400installs database-optimizer https://github.com/Jeffallan Investigates slow PostgreSQL and MySQL queries, breaks down execution plans with EXPLAIN ANALYZE, and drafts indexes without table locks. CX Codex +1 6,000installs mysql-patterns affaan-m Production patterns for MySQL and MariaDB schema design, indexing, transactions, and slow query diagnostics in AI coding agents. CX Codex +1 4,700installs

From the same set22

data-engineering-study-material A study guide skill for data engineering: explains concepts, shows pipeline examples, and helps with interview prep. CX Codex +1 2,000installs options-analytics-agent-langgraph Builds a LangGraph agent that pulls options data from Polygon.io, caches it in ChromaDB and keeps memory across sessions. Useful when you want your own trading assistant. CX Codex +1 2,000installs harvard-artifacts-collection-data-engineering This skill pulls Harvard Art Museums data into MySQL and renders it in Streamlit. Useful when you want a working ETL example from API to dashboard. CX Codex +1 1,900installs harvard-artifacts-collection-etl-analytics A skill for building an ETL pipeline and analytics dashboard on Harvard Art Museums API data with Python, SQL and Streamlit. CX Codex +1 1,900installs iac-terraform-data-engineering A skill for Claude and other AI agents that helps describe AWS data infrastructure in Terraform: S3 buckets, EC2 instances, IAM roles. CX Codex +1 1,800installs iac-data-engineering-terraform A skill with ready Terraform patterns for data engineering: S3 buckets, EC2 instances and IAM roles. Useful when you need to stand up pipeline infrastructure declaratively. CX Codex +1 1,800installs terraform-data-engineering-infrastructure A skill with Terraform patterns for data engineering: S3 data lake buckets, EC2 processing nodes, IAM roles. Useful when AWS infrastructure has to be described in code, not clicked together. CX Codex +1 1,800installs harvard-artifacts-etl-pipeline A skill that walks your coding agent through an ETL pipeline from the Harvard Art Museums API to Streamlit charts. CX Codex +1 1,700installs

Project sponsors

Companies that keep this analytics open
Gold sponsor
Nutra.Club

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor