Skip to main content
skill CX Codex

databricks-unstructured-pdf-generation: Claude Code skill

databricks-unstructured-pdf-generation creates synthetic PDF files and paired evaluation questions locally, then copies them to Databricks Unity Catalog volumes for RAG testing.

no license 328 installs ★ 408 updated 2026-10-24

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add databricks/databricks-agent-skills --skill databricks-unstructured-pdf-generation -a claude-code
Open on GitHub

What databricks-unstructured-pdf-generation does

This skill builds synthetic document collections for testing Databricks retrieval pipelines, such as Genie Agent setups or mlflow.genai.evaluate(). It writes domain-specific HTML pages into ./raw_data/html/ and converts them to PDF files using a bundled pdf_generator.py script that calls plutoprint.

Converted documents are copied into a Unity Catalog volume using databricks fs cp. The workflow also produces pdf_eval_questions.json, mapping each document to verification queries and expected facts.

Without databricks CLI version 1.0.0 or higher and the plutoprint library, conversions and volume sync will fail. Keep the evaluation JSON off the volume attached to a Genie Agent, because the agent indexes the entire volume and absorbs the test answers directly into its context.

What it helps with

  • produce synthetic multi-page PDFs from local HTML source files
  • sync test PDF batches to Databricks Unity Catalog volumes
  • build paired ground-truth question sets for RAG benchmarks
  • prepare evaluation data for Genie Agent without leaking answers into its index

Example prompts for the agent

  • Generate HTML troubleshooting guides in ./raw_data/html and convert them to PDF
  • Copy local PDFs from ./raw_data/pdf to volume dbfs:/Volumes/my_catalog/my_schema/raw_data/pdf
  • Create pdf_eval_questions.json paired with the generated manual PDFs

How to install databricks-unstructured-pdf-generation

1Skills CLI (Vercel)

npx skills add databricks/databricks-agent-skills --skill databricks-unstructured-pdf-generation -a claude-code

2Manually: put the files in place

~/.claude/skills/databricks-unstructured-pdf-generation/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/databricks-unstructured-pdf-generation/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about databricks-unstructured-pdf-generation

How do I install databricks-unstructured-pdf-generation in Claude Code?

Run npx skills add databricks/databricks-agent-skills --skill databricks-unstructured-pdf-generation -a claude-code.

What does databricks-unstructured-pdf-generation do?

It creates synthetic PDFs from HTML files and generates question-fact pairs to test unstructured RAG retrieval on Databricks.

What tools are required before running the script?

You need databricks CLI version 1.0.0 or later and the Python package plutoprint, installed with uv pip install plutoprint.

Similar skills

All skills for AI and ML →

From the same set30

The whole set →
databricks-mlflow-evaluation databricks-mlflow-evaluation — a skill for running mlflow.genai.evaluate(), building scorers and datasets, aligning judges with MemAlign, and watching production quality on Databricks. CX Codex +1 355installs databricks-ml-training databricks-ml-training is a skill for training classifiers and regressors on Databricks with XGBoost, scikit-learn, LightGBM, or PyTorch, and tracking runs with MLflow. CX Codex +1 354installs databricks-lakeflow-connect databricks-lakeflow-connect — a skill for Claude Code builds and debugs Lakeflow Connect ingestion from SQL Server, PostgreSQL, MySQL, and Oracle into Unity Catalog. It covers CDC and query-based loads. CX Codex +1 348installs databricks-zerobus-ingest The databricks-zerobus-ingest skill helps route events, logs, CDC, and telemetry into Databricks Delta tables. It fits streaming setups that do not need a separate broker. CX Codex +1 331installs databricks-iceberg databricks-iceberg — a skill for creating and managing Apache Iceberg tables on Databricks, syncing Delta with Iceberg via UniForm, and exposing tables to external engines through REST Catalog. CX Codex +1 327installs databricks-synthetic-data-gen databricks-synthetic-data-gen creates synthetic Databricks data with Spark and Faker in Parquet, JSON, CSV, or Delta. Use it for test data, demos, and analysis-ready datasets. CX Codex +1 314installs databricks-genie-agents Builds and configures Databricks Genie Agents over Unity Catalog tables, metric views, and volume documents with SQL query routing. CX Codex +1 282installs databricks-setup-local The databricks-setup-local skill previews, configures, or troubleshoots a local uv-managed Python .venv for Databricks. Use it for Databricks Connect, compute targets, job tasks, or bundles. CX Codex +1 153installs

Project sponsors

Companies that keep this analytics open