bigquery-agent-analytics-sdk — Claude Code skill: agent trace
A skill for analyzing AI agent telemetry in BigQuery: trace reconstruction, LLM-as-Judge evaluation, and drift detection.
npx skills add reason-machines/data-skills --skill bigquery-agent-analytics-sdk -a claude-codeWhat bigquery-agent-analytics-sdk does
The skill brings the bigquery-agent-analytics Python toolkit into your project. It reads agent events from BigQuery, stitches them into traces, and renders each one as an ASCII DAG. Event semantics helpers tell apart agent start, tool invocation, LLM call, and agent end.
Inside you get a Client with get_trace, get_traces_for_session and time-range queries, a ViewManager that splits events by type into BigQuery views, SystemEvaluator plus LLM-as-Judge evaluators, and the bqaa CLI with commands for diagnostics, evaluation, and Agent Context Graph extraction. Periodic materialization can be scheduled — that command provisions Cloud Scheduler and Cloud Run.
You need Python 3.10+, a Google Cloud project with BigQuery enabled, and agent traces already sitting in BigQuery. Auth goes through GOOGLE_APPLICATION_CREDENTIALS or gcloud auth application-default login. Skip that step and the client simply won't reach your dataset, so wire up credentials before the first run.
What it helps with
- rebuild agent traces from BigQuery events into one readable graph
- score agent responses with an LLM judge against chosen criteria
- compare the actual execution path with a golden one
- spot drift in agent behavior over a time window
- pull agent decisions out of the context graph
Example prompts for the agent
- show trace trace-abc-123 and render it as a DAG
- run llm-judge evaluation with criteria correctness and hallucination
- compare trajectories against the golden path plan,execute,verify
How to install bigquery-agent-analytics-sdk
1Skills CLI (Vercel)
npx skills add reason-machines/data-skills --skill bigquery-agent-analytics-sdk -a claude-code2Manually: put the files in place
~/.claude/skills/bigquery-agent-analytics-sdk/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/bigquery-agent-analytics-sdk/
1Skills CLI (Vercel)
npx skills add reason-machines/data-skills --skill bigquery-agent-analytics-sdk -a codex2Manually: put the files in place
.agents/skills/bigquery-agent-analytics-sdk/SKILL.mdFor all projects use ~/.agents/skills/
1Skills CLI (Vercel)
npx skills add reason-machines/data-skills --skill bigquery-agent-analytics-sdk -a cursor2Manually: put the files in place
.cursor/skills/bigquery-agent-analytics-sdk/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install reason-machines/data-skills bigquery-agent-analytics-sdk2Manually: put the files in place
.github/skills/bigquery-agent-analytics-sdk/SKILL.md1Skills CLI (Vercel)
npx skills add reason-machines/data-skills --skill bigquery-agent-analytics-sdk -a gemini-cli2Platform CLI
gemini skills install https://github.com/reason-machines/data-skills --path skills/bigquery-agent-analytics-sdkManually: put the files in place
.devin/skills/bigquery-agent-analytics-sdk/SKILL.mdThe legacy .windsurf/skills/ path still works
Skills CLI (Vercel)
npx skills add reason-machines/data-skills --skill bigquery-agent-analytics-sdk -a opencodeClaude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
Step by step, with commands for each platform: How to install skills in Claude Code: five ways
Questions about bigquery-agent-analytics-sdk
How do I install bigquery-agent-analytics-sdk in Claude?
Run npx skills add reason-machines/data-skills --skill bigquery-agent-analytics-sdk -a claude-code. The skill lands in ~/.claude/skills/bigquery-agent-analytics-sdk/SKILL.md.
What does bigquery-agent-analytics-sdk do?
It analyzes AI agent telemetry in BigQuery: reconstructs traces, builds per-event-type views, runs evaluations, and extracts decisions from the agent context graph.
What do I need before using it?
Python 3.10+, a Google Cloud project with BigQuery, and agent traces stored in BigQuery. Auth is set up via GOOGLE_APPLICATION_CREDENTIALS or gcloud auth application-default login.