Skip to main content
subagent CX Codex

ai-observability-engineer — Codex subagent: setup and use

ai-observability-engineer is a Codex subagent that designs telemetry, metrics, and tracing for production LLM pipelines. It steps in when probabilistic workflows require visibility.

MIT ★ 6,505 updated 2026-10-05

Install into Codex · Manually: put the files in place All methods and platforms ↓
.codex/agents/ai-observability-engineer.toml
Open on GitHub

What ai-observability-engineer does

The subagent maps runtime flows from prompt assembly and model invocations to tool interactions and response validation. It pinpoints obscure failure points where targeted signals improve diagnostic speed, producing a compact telemetry blueprint for debugging and evaluation.

Key areas cover latency, operational costs, fallback rates, and connecting client-facing errors to internal execution steps. The agent explicitly restricts indiscriminate logging of sensitive payloads unless structured sampling proves insufficient for tracking decisions.

Its configuration specifies the gpt-5.6-sol model. The final output details visibility gaps, priority telemetry points, and retention tradeoffs.

What it helps with

  • map tracing across retrieval, prompts, model calls, and tools
  • track production metrics for token cost, latency, and model refusals
  • identify observability blind spots inside probabilistic agent loops
  • define redaction boundaries for sensitive runtime payloads

Example prompts for the agent

  • Design a telemetry blueprint for an autonomous agent using tools
  • Identify blind spots and missing metrics in our LLM evaluation pipeline
  • Set up trace correlation between user errors and tool call failures

How to install ai-observability-engineer

Manually: put the files in place

.codex/agents/ai-observability-engineer.toml

Codex defines subagents in TOML: name, description, developer_instructions. Move the Markdown text into developer_instructions by hand. For all projects use ~/.codex/agents/

Step by step, with commands for each platform: Claude Code subagents: how to create one, call it and keep context clean

Questions about ai-observability-engineer

How to install ai-observability-engineer in Codex?

Place the subagent configuration file into .codex/agents/ai-observability-engineer.toml.

What does ai-observability-engineer do?

It maps execution paths across models and tools to recommend tracing, failure metrics, and privacy-preserving logging setups.

Which model powers ai-observability-engineer?

The subagent configuration specifies gpt-5.6-sol.

Source text

ai-observability-engineer.toml · MIT
# ai-observability-engineer

Use when a task needs AI-native traces, metrics, logging, and debugging signals for LLM or agent systems in production.

Own AI observability as system visibility for probabilistic workflows, not just conventional application logging.

Working mode:
1. Map the runtime path from input and context assembly through model calls, tool use, and final output.
2. Identify the least visible failure boundaries where better telemetry would change diagnosis quality.
3. Recommend the smallest observability model that supports debugging, evaluation, and governance needs.
4. Check operational cost, privacy, and retention tradeoffs.

Focus on:
- traces across retrieval, prompts, model calls, tool actions, and output validation
- metrics for quality, latency, cost, refusals, fallback rates, and error classes
- logging strategy for prompts, context summaries, tool arguments, and decision breadcrumbs
- correlation between user-visible failures and internal execution paths
- privacy, redaction, and retention boundaries for sensitive inputs or outputs

Quality checks:
- verify each telemetry recommendation helps answer a real debugging question
- avoid logging raw sensitive data when derived signals are sufficient
- ensure quality signals can be joined with operational traces
- call out observability blind spots that still need eval coverage

Return:
- current visibility gaps
- recommended telemetry model and priority signals
- cost/privacy tradeoffs and implementation notes
- debugging or alerting use cases enabled by the design
- residual blind spots and next steps

Do not recommend indiscriminate full-payload logging when safer structured or sampled telemetry can answer the same questions unless explicitly requested by the parent agent.

© VoltAgent · MIT · VoltAgent/awesome-codex-subagents

Similar subagents

All subagents for AI and ML →

From the same set176

The whole set →
ponder-reviewer ponder-reviewer — a subagent for Codex runs a coverage-gated, multi-pass deliberative review protocol with false-positive retraction. CX Codex ★ 6,505repo stars prompt-regression-tester prompt-regression-tester is a Codex subagent that builds regression coverage for changes to AI prompts, models, tools, or workflows. It identifies likely behavior shifts and suggests test criteria. CX Codex ★ 6,505repo stars hallucination-investigator hallucination-investigator is a Codex subagent that diagnoses why AI outputs fail, tracing errors to context, retrieval, prompts, tools, or unsupported inference. CX Codex ★ 6,505repo stars eval-engineer eval-engineer — a Codex subagent that designs evaluation setups for prompts, retrieval pipelines, tool calling, and multi-step agents. CX Codex ★ 6,505repo stars platform-product-manager platform-product-manager — a Codex subagent for internal platform work: it turns team pain points into a roadmap with adoption metrics and stated tradeoffs. CX Codex ★ 6,505repo stars idp-architect idp-architect designs internal developer platform architectures, service boundaries, and self-service control planes for engineering teams. CX Codex ★ 6,505repo stars golden-path-designer golden-path-designer designs a standard route for creating, deploying, and operating services. Use it when a team needs sensible defaults and clear boundaries for exceptions. CX Codex ★ 6,505repo stars backstage-specialist backstage-specialist plans an internal developer portal on Backstage: service catalog, scaffolder templates, plugin choices and a rollout path. CX Codex ★ 6,505repo stars

Project sponsors

Companies that keep this analytics open