arize-ax GitHub Copilot plugin: installation and features

Q: How do I install arize-ax in GitHub Copilot?

Run `copilot plugin install arize-ax@awesome-copilot`.

Q: What tools are included in arize-ax?

The set includes the `ax CLI` plus skills for instrumentation, datasets, experiments, evaluators, AI provider integrations, annotations, and deep links to the Arize UI.

What arize-ax does

arize-ax brings Arize AX workflows into GitHub Copilot. With the ax CLI, you can export and inspect traces and spans, create versioned evaluation datasets, run experiments, and compare their results.

The plugin also includes skills for LLM-as-judge evaluators, LLM provider credentials, annotation configs, and bulk labels for spans. Other skills add Arize AX tracing through a two-phase workflow, tune prompts with production trace data, evaluations, and annotations, and create deep links to traces, sessions, datasets, and other Arize UI views.

Install it when your project uses Arize AX and you want tracing, evaluation, and prompt work in one Copilot workflow. It is a poor fit for projects that do not use this service.

What it helps with

export traces and spans to debug an LLM application
build a versioned evaluation dataset
run experiments against a dataset and compare results
create an LLM-as-judge evaluator
generate a deep link to an Arize UI trace or dataset

Example prompts for the agent

Export and analyze the traces for this LLM application with the `ax CLI`.
Create an evaluation dataset, run an experiment, and compare the results.
Add Arize AX tracing to this application and generate a deep link for the target span.

How to install arize-ax

Command from the source

copilot plugin install arize-ax@awesome-copilot

From the same set554

The whole set →

git-commit official github This skill reviews Git changes, stages related files, and creates Conventional Commits. Use it when you want an agent to make one commit or split work into separate commits. GitHub Copilot 47,165installs excalidraw-diagram-generator official github Turn a plain-language description into an Excalidraw diagram. Useful for mapping processes, system structure, and relationships between entities. GitHub Copilot 31,639installs multi-stage-dockerfile official github This skill guides GitHub Copilot in writing multi-stage Dockerfiles for different languages and frameworks. Use it when the final runtime image should contain fewer build dependencies. GitHub Copilot 29,688installs documentation-writer official github Skill that turns the agent into a technical writer following the Diátaxis framework: tutorials, how-to guides, reference, and explanation. Proposes structure before writing. GitHub Copilot 27,757installs prd official github Turns a feature idea into a structured PRD with user stories, technical requirements, and risks. Use it when planning a software feature or an AI-powered one. GitHub Copilot 24,035installs refactor official github This skill reshapes existing code without changing its external behavior. Use it for gradual cleanup of large functions, duplication, weak types, and code smells. GitHub Copilot 22,321installs java-springboot official github Gives GitHub Copilot Spring Boot development practices, from project layout to tests and security. Use it when writing or reviewing Java application code. GitHub Copilot 21,272installs create-readme official github This skill reviews a project and creates a structured README.md. Use it when the repository needs clear documentation based on its actual files and code. GitHub Copilot 19,081installs

Questions about arize-ax

How do I install arize-ax in GitHub Copilot?

Run copilot plugin install arize-ax@awesome-copilot.

What does arize-ax do?

The plugin adds skills for LLM application tracing, evaluation datasets, experiments, evaluators, annotations, and prompt optimization in Arize AX.

What tools are included in arize-ax?

The set includes the ax CLI plus skills for instrumentation, datasets, experiments, evaluators, AI provider integrations, annotations, and deep links to the Arize UI.

Source text

arize-ax · MIT

# Arize AX Plugin

Arize AX platform skills for LLM observability, evaluation, and optimization. Includes trace export, instrumentation, datasets, experiments, evaluators, AI provider integrations, annotations, prompt optimization, and deep linking to the Arize UI.

## Installation

```bash
# Using Copilot CLI
copilot plugin install arize-ax@awesome-copilot
```

## What's Included

### Skills

| Skill | Description |
|-------|-------------|
| `arize-trace` | Export and analyze Arize traces and spans for debugging LLM applications using the ax CLI. |
| `arize-instrumentation` | Add Arize AX tracing to applications using a two-phase agent-assisted workflow. |
| `arize-dataset` | Create, manage, and query versioned evaluation datasets using the ax CLI. |
| `arize-experiment` | Run experiments against datasets and compare results using the ax CLI. |
| `arize-evaluator` | Create and run LLM-as-judge evaluators for automated scoring of spans and experiments. |
| `arize-ai-provider-integration` | Store and manage LLM provider credentials for use with evaluators. |
| `arize-annotation` | Create annotation configs and bulk-apply human feedback labels to spans. |
| `arize-prompt-optimization` | Optimize LLM prompts using production trace data, evaluations, and annotations. |
| `arize-link` | Generate deep links to the Arize UI for traces, spans, sessions, datasets, and more. |

arize-ax — GitHub Copilot plugin: what it does, how to install