test-triage — Codex skill: what it does, how to install
Triages macOS test failures across Xcode and SwiftPM. It narrows failing scopes and separates flaky tests or setup issues from actual regressions.
npx skills add openai/plugins --skill test-triage -a codexWhat test-triage does
The skill detects whether a project relies on Xcode or SwiftPM, then runs xcodebuild test or swift test. It focuses on the smallest likely failing target or specified test filter instead of rerunning the entire suite. Focused reruns save time.
Each failure is sorted into a clear category: build failure, assertion error, process crash, async timing flake, or missing host entitlements. The workflow also spots cases where a macOS test mistakenly expects an iOS simulator environment.
Install this skill if you debug Swift and macOS test suites regularly. If your project has no automated tests, you can skip it.
What it helps with
- Narrow down failing test scopes in macOS projects
- Distinguish async timing flakes from genuine code bugs
- Identify missing host app entitlements or setup failures
- Rerun only the specific failing target without full-suite overhead
Example prompts for the agent
- Triage the assertion failure in our SwiftPM test suite
- Run the failing Xcode test target and classify the crash
- Check if this macOS test failure is caused by an iOS-only assumption
How to install test-triage
1Skills CLI (Vercel)
npx skills add openai/plugins --skill test-triage -a codex2Manually: put the files in place
.agents/skills/test-triage/SKILL.mdFor all projects use ~/.agents/skills/
1Skills CLI (Vercel)
npx skills add openai/plugins --skill test-triage -a claude-code2Manually: put the files in place
~/.claude/skills/test-triage/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/test-triage/
Manually: put the files in place
.cursor/skills/test-triage/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install openai/plugins test-triage2Manually: put the files in place
.github/skills/test-triage/SKILL.mdPlatform CLI
gemini skills install https://github.com/openai/plugins --path plugins/build-macos-apps/skills/test-triageManually: put the files in place
.devin/skills/test-triage/SKILL.mdThe legacy .windsurf/skills/ path still works
Claude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
From the same set201
The whole set →Similar
Questions about test-triage
How do I install test-triage in Codex?
Run npx skills add openai/plugins --skill test-triage in your project folder. The skill definition is placed in .agents/skills/test-triage/SKILL.md.
What does test-triage do?
It analyzes macOS test results, groups errors into categories like crashes, flakes, or build issues, and suggests the next verification step.
Which test runners does test-triage support?
It detects and runs tests using xcodebuild test for Xcode projects and swift test for SwiftPM packages.
Source text
SKILL.md · MIT
--- name: test-triage description: Triage macOS tests across Xcode and SwiftPM. Use when narrowing failures, explaining assertions or crashes, or separating setup from regressions. --- # Test Triage ## Quick Start Use this skill to run the smallest meaningful test scope first, classify failures precisely, and avoid treating every test failure like a product bug. ## Workflow 1. Detect the test harness. - Use `xcodebuild test` for Xcode-based projects. - Use `swift test` for SwiftPM packages. 2. Narrow the scope. - If the user gave a target, product, or test filter, use it. - If not, prefer the smallest likely failing target before a full suite. 3. Classify the result. - Build failure - Assertion failure - Crash or signal - Async timing or flake - Environment or fixture setup issue - Missing entitlement or host app issue 4. Rerun intelligently. - Use focused reruns when a specific case fails. - Avoid burning time on full-suite reruns without new information. 5. Summarize clearly. - What command ran - Which tests failed - What kind of failure it was - The best next proof step or fix path ## Guardrails - Distinguish compilation failures from test execution failures. - Call out when a test appears to assume iOS-only or simulator-only behavior. - Mark likely flakes as such instead of overstating confidence. ## Output Expectations Provide: - the command used - the smallest failing scope - the top failure category - a concise explanation of the likely cause - the next rerun or fix step
© OpenAI · MIT · openai/plugins