Skip to main content
skill CX Codex GP ChatGPT official · OpenAI

test-triage — Codex skill: what it does, how to install

Triages macOS test failures across Xcode and SwiftPM. It narrows failing scopes and separates flaky tests or setup issues from actual regressions.

Install into Codex · Skills CLI (Vercel) All methods and platforms ↓
npx skills add openai/plugins --skill test-triage -a codex
Open on GitHub

What test-triage does

The skill detects whether a project relies on Xcode or SwiftPM, then runs xcodebuild test or swift test. It focuses on the smallest likely failing target or specified test filter instead of rerunning the entire suite. Focused reruns save time.

Each failure is sorted into a clear category: build failure, assertion error, process crash, async timing flake, or missing host entitlements. The workflow also spots cases where a macOS test mistakenly expects an iOS simulator environment.

Install this skill if you debug Swift and macOS test suites regularly. If your project has no automated tests, you can skip it.

What it helps with

  • Narrow down failing test scopes in macOS projects
  • Distinguish async timing flakes from genuine code bugs
  • Identify missing host app entitlements or setup failures
  • Rerun only the specific failing target without full-suite overhead

Example prompts for the agent

  • Triage the assertion failure in our SwiftPM test suite
  • Run the failing Xcode test target and classify the crash
  • Check if this macOS test failure is caused by an iOS-only assumption

How to install test-triage

1Skills CLI (Vercel)

npx skills add openai/plugins --skill test-triage -a codex

2Manually: put the files in place

.agents/skills/test-triage/SKILL.md

For all projects use ~/.agents/skills/

From the same set201

The whole set →
supabase official supabase Guides the agent through database configuration and strict RLS policies in Supabase. CX Codex GP ChatGPT 8installs remotion-render official Remotion Exports videos and static stills from Remotion projects using CLI commands. CX Codex GP ChatGPT 3installs figma-create-new-file official Figma Creates blank Figma, FigJam, or Slides files inside draft folders. It resolves planKey and editor types before invoking Figma MCP tools. CX Codex GP ChatGPT 6installs swiftui-performance-audit official OpenAI Pinpoints SwiftUI runtime issues like frame drops, unresponsive taps, and excessive view body computations. Works code-first and guides Instruments profiling. CX Codex GP ChatGPT 109installs swiftui-liquid-glass official OpenAI This skill helps build and review SwiftUI Liquid Glass interfaces for iOS 26+. Use it when adopting the API or checking fallbacks, interaction, and design fit. CX Codex GP ChatGPT 121installs swiftui-ui-patterns official OpenAI This skill helps build and refactor SwiftUI interfaces, from navigation and state to layouts and controls. Use it for new screens or changes to an existing project. CX Codex GP ChatGPT 114installs swiftui-view-refactor official OpenAI Refactors SwiftUI view files into clean, testable structures with dedicated subview types and proper Observation ownership. CX Codex GP ChatGPT 113installs ios-memgraph-leaks official OpenAI Captures and inspects iOS leaks from a simulator process or .memgraph. Useful for tracing retained objects and checking a fix with before-and-after evidence. CX Codex GP ChatGPT 1,054installs

Similar

Questions about test-triage

How do I install test-triage in Codex?

Run npx skills add openai/plugins --skill test-triage in your project folder. The skill definition is placed in .agents/skills/test-triage/SKILL.md.

What does test-triage do?

It analyzes macOS test results, groups errors into categories like crashes, flakes, or build issues, and suggests the next verification step.

Which test runners does test-triage support?

It detects and runs tests using xcodebuild test for Xcode projects and swift test for SwiftPM packages.

Source text

SKILL.md · MIT
---
name: test-triage
description: Triage macOS tests across Xcode and SwiftPM. Use when narrowing failures, explaining assertions or crashes, or separating setup from regressions.
---

# Test Triage

## Quick Start

Use this skill to run the smallest meaningful test scope first, classify
failures precisely, and avoid treating every test failure like a product bug.

## Workflow

1. Detect the test harness.
   - Use `xcodebuild test` for Xcode-based projects.
   - Use `swift test` for SwiftPM packages.

2. Narrow the scope.
   - If the user gave a target, product, or test filter, use it.
   - If not, prefer the smallest likely failing target before a full suite.

3. Classify the result.
   - Build failure
   - Assertion failure
   - Crash or signal
   - Async timing or flake
   - Environment or fixture setup issue
   - Missing entitlement or host app issue

4. Rerun intelligently.
   - Use focused reruns when a specific case fails.
   - Avoid burning time on full-suite reruns without new information.

5. Summarize clearly.
   - What command ran
   - Which tests failed
   - What kind of failure it was
   - The best next proof step or fix path

## Guardrails

- Distinguish compilation failures from test execution failures.
- Call out when a test appears to assume iOS-only or simulator-only behavior.
- Mark likely flakes as such instead of overstating confidence.

## Output Expectations

Provide:
- the command used
- the smallest failing scope
- the top failure category
- a concise explanation of the likely cause
- the next rerun or fix step

© OpenAI · MIT · openai/plugins

See also

Project sponsors

Companies that keep this analytics open
Gold sponsor

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor